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CHAPTER  1 
INTRODUCTION 

1.1.  Overview 

The  main  components  of  many  control  systems,  such  as  actuators  and  sensors,  change 
with  time.  These  systems  can,  therefore,  be  modeled  as  linear  time-varying  multivariable 
continuous  systems.  Much  research  has  already  been  conducted  in  the  area  of  the  control  of 
such  systems.  Techniques  exist  which  utilize  the  concepts  of  controllability,  observability, 
and  stabilization  to  transform  such  systems  into  canonical  forms  so  that  state  estimation  and 
state  feedback  techniques  can  be  applied  to  control  the  system  [18]-[22].  Another  technique 
exists  to  transform  linear  multivariable  systems  that  are  minimally  observable  into  equivalent 
canonical  forms  [  5].  There  is  also  a  scheme  which  stabilizes  controllable  time-varying 
systems  [29].  Another  study  found  that  if  a  time- varying  system  is  lexicografixedly 
controllable,  then  there  exists  a  state  feedback  controller  [21]  to  stabilize  the  system  by 
assigning  an  arbitrary  set  of  eigenvalues  to  the  closed-loop  feedback  system. 

Microprocessors  are  used  in  most  modem  control  systems.  Their  use  depends  on  the 
techniques  taught  in  discrete-time  or  computer  control  courses  [23].  However,  these 
techniques  deal  mainly  with  time-invariant  discrete  systems.  The  concepts  of  controllability, 
observability,  and  stabilization  for  linear  time- varying  multivariable  discrete  systems  have 
not  yet  been  exploited.  Therefore,  state  estimation  and  state  feedback  techniques  do  not  exist 
for  such  systems.  The  lack  of  research  in  this  area  is  probably  due  to  the  mathematical 
difficulties  involved  in  solving  such  systems. 
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The  outputs  of  linear  time-varying  components,  such  as  actuators  and  sensors,  are 
typically  used  as  inputs  to  computer  control  systems.  The  resulting  system  is  modeled  as  a 
linear  time-varying  multivariable  discrete  control  system.  Since  the  techniques  of  state 
feedback  and  state  estimation  do  not  exist  for  such  systems,  control  engineers  are  forced  to 
use  intuition  and  experience  instead  of  theory  to  design  these  control  systems. 

This  research  considers  the  control  problem  of  a  linear  time-varying  continuous 
system  that  is  not  lexicografixedly  controllable  [20].  A  state  feedback  technique  to  stabilize 
such  systems  does  not  currently  exist.  A  new  approach,  which  considers  the  discretization  of 
the  linear  time-varying  continuous  system  and  the  selection  of  a  sampling  period  to  make  the 
resulting  discrete  system  lexicografixedly  controllable,  is  proposed.  Algorithms  needed  to 
control  the  resulting  linear  time-varying  discrete  system  are  also  developed. 

1.2.  Problem  Statement 

A  technique  to  control  linear  time-varying  multivariable  continuous  systems  which 
are  not  lexicografixedly  controllable  must  be  developed.  The  following  statement  defines  the 
problem  considered  in  this  report: 

Given  a  linear  time-varying  multivariable  continuous  system  that  is  not 
lexicografixedly  controllable,  discretize  the  system  through  the  application  of 
sample  and  zero-order  hold  devices  and  then  develop  a  method  to  stabilize  the 
resulting  discrete  system  through  the  application  of  state  feedback. 

The  following  obstacles  must  be  overcome  in  order  to  solve  this  problem: 

1)  Equations  which  model  the  resulting  discrete  system  must  be  derived. 
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2) 


A  controllability  theorem  for  linear  time-varying  discrete  systems  must  be 
developed. 

3)  A  state  feedback  technique  which  asymptotically  stabilizes  the  linear  time- 
varying  discrete  system  must  be  developed. 

This  research  effort  focuses  on  overcoming  these  obstacles. 

1.3.  Research  Results 

The  results  of  this  In-House  Laboratory  Independent  Research  (ILIR)  program 
provide  advances  in  the  theory  of  the  control  of  linear  systems.  Contributions  which  advance 
control  theory  are  made  in  the  areas  of  discretization,  controllability,  canonical 
transformation,  state  feedback,  and  stabilization.  Control  algorithms  are  developed  and 
coded  in  the  Maple  language  to  form  a  library  of  Maple  Symbolic  Math  routines  which  can 
be  used  in  the  design  and  simulation  of  physical  systems. 

1.4.  Transition  of  Research 

The  results  of  this  research  are  relevant  to  all  military  and  commercial  systems  that 
use  time- varying  components  as  inputs  to  microprocessor-based  control  systems.  Results 
will  be  directly  transitioned  into  Army  prototype  designs  for  generator  set  controls,  electrical 
machinery  controls,  engine  governor  controllers,  electric  drive  systems,  and  robotic  systems. 
These  results  will  also  be  transitioned  to  the  commercial  and  academic  communities  through 
technical  publications  and  presentations  at  conferences  and  symposia.  The  principal 
investigator  presented  an  invited  paper  documenting  interim  ILIR  results  on  controllability 
and  served  as  a  Session  Chair  at  the  1994  International  Conference  on  Computers  and  Their 
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Applications  [15].  Interim  ILIR  results  on  state  feedback  and  stabilization  were  presented  in 
another  document  [16]. 

1.5.  Report  Organization 

An  overview  of  the  report  is  given  in  Chapter  1 .  Relevant  background  information 
pertaining  to  linear  continuous  and  discrete  systems  is  reviewed  in  Chapter  2.  Chapter  3  is 
devoted  to  the  discretization  of  linear  time- varying  continuous  systems.  Equations  modeling 
the  discretized  system  in  terms  of  its  associated  continuous  system  are  derived.  A 
controllability  theorem  for  the  class  of  systems  discretized  in  Chapter  3  is  developed  and  its 
associated  controllability  matrix  is  derived  in  Chapter  4.  These  results  are  used  in  the 
development  of  an  equivalence  transformation  and  a  state  feedback  theorem  found  in  Chapter 
5.  An  algorithm  which  asymptotically  stabilizes  the  above  class  of  linear  time- varying 
discrete  systems  is  also  presented.  Chapter  6  presents  a  summary  of  the  report  and  provides 
recommendations  for  future  research.  Appendix  A  includes  the  Maple  control  algorithms 
used  to  solve  the  example  problems  in  Chapters  3-5.  A  copy  of  the  ISCA  paper  documenting 
interim  ILIR  results  is  included  as  Appendix  B. 
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CHAPTER  2 

REVIEW  OF  LINEAR  SYSTEMS 


2.1.  Introduction 

This  chapter  reviews  the  research  underlying  the  development  of  linear  continuous 
and  linear  discrete  systems.  Sections  2.2  and  2.3  present  the  mathematical  models  describing 
linear  continuous  and  linear  discrete  systems  and  the  associated  concepts  of  controllability, 
canonical  transformations,  and  stabilization.  It  is  these  models  and  concepts  which  are  used 
as  the  groundwork  in  the  solution  of  the  problem  statement  presented  in  Chapter  1. 


2.2.  Linear  Continuous  Systems 


The  input-output  description  of  a  system  gives  the  mathematical  relationship  between 
the  inputs  and  the  outputs  [6].  A  continuous  system  with  p  inputs  and  q  outputs  can  be 
represented  by  the  following  figure. 


Figure  2-1  Linear  Time-Varying  Multivariable  Continuous  System 

The  system  is  said  to  be  relaxed  if  there  is  no  energy  stored  in  the  system  at  time  t  =  The 


mathematical  relationship  between  the  inputs  and  the  outputs  of  a  relaxed  system  is  given  by 

y(t)  =  H{u(t)}, 


(2-1) 
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where  y(t)  is  the  (qxl)  output  vector,  u(t)  is  the  (pxl)  input  vector,  and  H{  }  is  some  operator 
or  function  that  uniquely  specifies  the  output  y(t)  in  terms  of  the  input  u(t). 

A  linear  continuous  system  is  one  in  which  the  principle  of  superposition  applies  [25]. 
That  is,  if  y^t)  is  the  response  to  the  input  u,(t)  and  y2(t)  is  the  response  to  the  input  u2(t)  then 

the  system  is  linear  if  and  only  if,  for  every  scalar  a  and  P,  the  response  to  the  input 
aUj(t)+Pu2(t)  is  ayj(t)+Py2(t).  Such  a  system  can  be  modeled  by  the  following  state  and 
input  equations  [  6], 

x(t)  =  A(t)x(t)  +  B(t)u(t) 


and 


(2-2) 


y(t)  =  C(t)x(t)  +  E(t)u(t) , 


(2-3) 

where  x(t)  is  the  (nxl)  state  vector,  A(t)  is  the  (nxn)  state  matrix,  B(t)  is  the  (nxp)  input 
matrix,  C(t)  is  the  (qxn)  output  matrix,  and  E(t)  is  the  (qxp)  direct  transmission  matrix. 

The  solution  to  the  state  equation  ( 2-2)  of  the  linear  time-varying  continuous  system 
is  given  in  [24]  as 

t 

x(t)  =  O(t,t0)x0  +  J  3>(t,T)B(T)u(T)dT  , 

‘o 

(2-4) 

where  the  matrix  O(t,t0)  is  referred  to  as  the  state  transition  matrix.  The  state  transition 
matrix  is  the  unique  solution  to 
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<J>(t,t0)  =  A(t)<D(t,t0). 


(2-5) 

Equation  ( 2-4)  shows  that  the  state  transition  matrix  completely  determines  the  solution  of 
the  state  equation  ( 2-2).  The  solution  of  ( 2-5)  is  very  difficult,  except  for  the  following 
special  cases. 

Special  Case  1:  Triangular  State  Matrix 

If  the  state  matrix  A(t)  of  the  continuous  system  is  a  triangular  matrix  then  the 
solution  of  ( 2-5)  can  be  reduced  to  that  of  solving  a  set  of  scalar  differential  equations  [  6]. 

In  this  case  the  state  transition  matrix  can  be  readily  obtained  from  the  following  equation, 

4>(t,t0)  =  'E(t)'P-1(t0) 


(2-6) 

where  'P(t)  is  any  fundamental  matrix  consisting  of  any  n  linearly  independent  solutions  of 

x(t)  =  A(t)x(t). 


(2-7) 

Special  Case  2:  Commutative  State  Matrix 

If  the  state  matrix  A(t)  of  the  continuous  system  has  the  following  commutative 
property 

t  t 

A(t)  J  A(x)di  =  J  A(x)dx  A(t) 

_l0  lo 


(2-8) 


for  all  t  and  tQ,  then  the  unique  solution  of  ( 2-5)  is  given  in  [  6]  as 


[ 

<$(t,t0)  =  exp  J  A(x)dx  . 


(2-9) 


It  has  been  shown  in  [  6]  that: 

1)  if  A(t)  is  a  diagonal  or  a  constant  matrix,  or 

2)  if  there  is  only  one  state 

then  the  commutative  property  holds  and  ( 2-9)  can  be  used  directly. 

Special  Case  3:  Class 

If  there  exists  a  constant  matrix  Ar  such  that  the  state  matrix  A(t)  of  the  continuous 
system  satisfies  the  following  property 


A(t)  =  AjA(t)- A(t)Aj, 


then  the  state  transition  matrix  can  be  computed  by  the  following  equation  [30]. 


(2-10) 


<l>(t,t0)  =  exp(A,t)exp[A2(t  -  tJJexpt-A,^) 


Note  that  the  constant  matrix  Aj  is  not  unique.  The  constant  matrix  A2  is  given  by 


(2-11) 


A2  =  exp(— A  j  t0 )  [A(t0 )  —  A  j  ]  exp(  A  2 10 ) . 


(2-12) 
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Special  Case  4:  (h(t)  and  Aj)  Class 

If  there  exists  a  constant  matrix  Aj  and  a  non-zero  scalar  time  function  h(t)  such  that 
the  derivative  of  h(t)  exists  and  the  state  matrix  A(t)  of  the  continuous  system  satisfies  the 


following  property 


A,A(t)-A(t)A, 

h(t)  h2(t) 


then  the  state  transition  matrix  can  be  computed  by  [30], 


(2-13) 


®(t,t0)  =  exp(A,g(t))exp(A2g(t)) 


(2-14) 


where,  the  scalar  time  function  g(t)  is  given  by 


I 

g(t)  =  J  h(x)dx 


(2-15) 


Note  that  the  constant  matrix  Al  and  the  scalar  time  function  h(t)  are  not  unique.  The 


constant  matrix  A  is  given  by 


^2  —  Ah(t0)  Ap 


(2-16) 


where 


(2-17) 
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2.2.1.  Controllability 


The  concept  of  controllability  plays  an  important  role  in  the  optimal  control  of  linear 
multivariable  systems.  If  a  given  linear  continuous  system  satisfies  the  condition  of  state 
controllability  then  closed-loop  poles  can  be  selected,  such  that  the  system  that  possesses 
such  poles  can  be  designed  using  state  feedback  techniques. 

There  are  different  degrees  of  controllability;  state  controllability,  uniform 
controllability,  and  lexicografixed  controllability.  The  definition  of  each  degree  is  defined  as 
follows: 

Definition  2.1  The  state  equation  (  2-2)  is  said  to  be  state  controllable  at  time  tff  if 
there  exists  a  finite  time  tI>tQ  such  that  for  any  x(tQ  )  and  x(tj )  in  the  state  space,  there  exists 
an  input  u(t),  applied  from  tQ  to  t} ,  that  will  transfer  the  state  x(tQ)  to  the  state  x(tj )  in  a  finite 
time. 


A  controllability  matrix  M(t)  is  used  to  test  for  the  condition  of  state  controllability. 
The  controllability  matrix  M(t)  of  the  continuous  system  given  in 
( 2-2)  is  defined  in[18]  as 

M(t)  =  [Mj  (t)  M2(t)  -  M,(t)], 


where 


(2-18) 


Mi(t)  =  Zi-,[B(t)] 


for  i=l,2,...,n.  The  differential  matrix  operator  Z[]  is  given  in[18]  as 


(2-19) 
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( 2-20) 


zH—A(t)H +  £[•]. 

at 


where 


Zq[-]  s  ZZ-Z[) 
q  times 


and 


(2-21) 


Z°[.]sH. 


( 2-22) 


If  the  state  and  input  matrices  of  the  state  equation  are  (n-1)  times  continuously 
differentiable,  then  the  state  equation  is  state  controllable  at  time  tQ  if  there  exists  a  time  tj>t0 
such  that 


rank[M(t)]  =  n. 


( 2-23) 

Definition  2.2  The  state  equation  ( 2-2)  of  a  linear  time-varying  continuous  system  is 
said  to  be  uniformly  controllable  on  the  time  interval  [ tQ,t ■  ],  if 

rank[M(t)]  =  n 


(2-24) 

for  all  t£  [tQ,  tj  ]. 

Definition  2.3  A  uniformly  controllable  system  whose  controllability  matrix  M(t)  has 
a  fixed  lexicographic  basis  on  the  time  interval  [t0,tj]  is  said  to  be  lexicografixedly 
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controllable  on  [tQ,  t]  ].  The  system  is  lexicografixedly  controllable  on  the  time  interval 
[tQ ,  tj  ]  if  there  exists  an  (nxn)  sub-matrix  ofM(t)  that  has  full  rank  for  all  tz[tQ>  tJ  ]. 


2.2.2.  Equivalence  Transformations 

Transforming  a  linear  system  into  an  equivalent  canonical  form  is  an  important 
technique  used  by  control  system  designers.  It  allows  the  designer  to  work  with  a  minimum 
number  of  system  parameters  [20],  An  equivalence  transformation  is  defined  as  follows: 

Definition  2.4  Consider  the  linear  time-varying  continuous  system  given  by 
(  2-2).  If  there  exists  an  (nxn)  matrix  Q( t)  which  is  nonsingular  and  continuously 
differentiable  in  tfor  all  tz[t} ,  t2 )  such  that  x(t)  =  Q(t)x(t),  then  the  system  described  by 

x(t)  =  A(t)x(t)  +  B(t)u(t), 


(2-25) 

is  said  to  be  equivalent  to  the  original  system  (  2-2)  and  the  matrix  Q(t)  is  said  to  be  an 
equivalence  transformation  on  [tt ,  t2  ]. 

The  equivalent  state  and  input  matrices  of  ( 2-25)  can  be  computed  as 

A(t)  =  {Q(t)A(t)  +  Q(t))Q-,(t) 


( 2-26) 
and 


B(t)  =  Q(t)B(t). 


( 2-27) 

Several  techniques  to  transform  linear  systems  into  particular  equivalent  canonical 
forms  already  exist.  Five  such  transformations  for  the  class  of  linear  time- varying 
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lexicografixedly  controllable  continuous  systems  were  developed  by  Nguyen  [18].  Since 
Nguyen’s  second  canonical  transformation  was  found  to  be  useful  in  the  solution  of  the 
problem  statement  in  Chapter  1,  the  development  of  this  transformation  is  presented  in  the 
following  section. 


2.2.2.I.  Nguyen’s  Second  Canonical  Transformation 

Nguyen’s  second  canonical  transformation  [18]  converts  a  given  linear  time- varying 
multivariable  system  ( 2-2)  which  satisfies  the  property  of  lexicografixed  controllability  into 
an  equivalent  system  ( 2-25).  The  associated  equivalent  state  and  input  matrices  have  the 
following  canonical  structure, 

An(t)  A12(t)  Alp(t)" 

-j-  A2J(t)  A22(t)  •••  A2p(t) 

,Api(t)  Ap2(t)  App(t)_ 


( 2-28) 


( 2-29) 
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( 2-30) 


for  i^j,  i,j=l,2,...,p,  and 


"±1 

X 

...  x" 

0 

0 

...  0 

0 

0 

...  0 

B(t)  = 

J 

0 

0 

...  +1 

0 

0 

...  0 

.0 

0 

...  0. 

P 


Nguyen’s  second  canonical  transformation  is  defined  as 


Q(t)  = 


Qi(t) 

Q2(t) 


LQp(t) 


(2-31) 


( 2-32) 


where 


Qi  (t)  = 


L  [p,]  J 


( 2-33) 


for  i=l,2,...,p.  The  differential  matrix  operator  W[  ]  is  defined  as 


W[-]  =  [-]A(t)  +  “-[■]. 

at 


(2-34) 

The  row  vector  p.  can  be  computed  as  follows.  Let  the  input  matrix  of  the  given  system  be 
represented  by 

B(t)  =  [bj (t)  b2(t)  -  bp(t)]. 


(2-35) 


The  controllability  matrix  (2-18)  can  then  be  written  as 

M(t)  =  [b,(t)-bp(t)  Z[b,(t)]-Z[bp(t)]  -  Z""1  [b,(t)]...Zn"1[bp(t)]]. 


(2-36) 

If  the  system  is  lexicografixedly  controllable,  then  a  unique  set  of  n  linearly  independent 
column  vectors  of  M(t)  can  be  found.  The  selected  vectors  can  be  rearranged  to  form  the 
following  nonsingular  matrix, 

M(t)  =  [M,(t)  M2(t)  -.  Mp(t)] 


where 


( 2-37) 


M,(t)  =  [b,(t)  Z[b,(t)]  -  Z"--'[b,(t)]] 


( 2-38) 
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for  i=l,2,...,p  and  where  the  subsystem  controllability  index  m.  is  defined  as  the  highest 
integer  for  which  Zm'‘1[bj(t)]  is  linearly  independent  of  other  column  vectors  of  ( 2-37).  The 
inverse  of  ( 2-37)  can  be  represented  as 


Pi.o(t) 

P,.,  (») 


M-'(t) 


Pi..,-i(0 


P,,(0 

pPJ(t) 


p 


p,m 


where  the  p.  .’s  are  the  row  vectors  of  M_1(t).  Pk is  defined  in  [18]  as 

Pk  Pk,mk-1 


for  k=l,2,...,p. 


( 2-39) 


(2-40) 


Nguyen’s  second  canonical  transformation  can  now  be  computed  by  substituting 
( 2-34)  and  ( 2-40)  into  ( 2-32)  and  ( 2-33). 


2.2.2.I.I.  Example 

The  application  of  Nguyen’s  second  canonical  transformation  to  the  following  linear 
time-varying  multivariable  continuous  system, 
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i  t3  ol  To  o' 

x(t)  =  0  2  t2  x(t)+  1  1  u(t) 


:  U  2 
_t  0 


(2-41) 


produces  an  equivalent  system  with  the  following  canonical  structure, 


r-3t"  +  3  6t”‘  +  3f2  -  2 


x(t)  =  . 1 

0 


3  —  2t 


t4  i  r_i  -i 

0  x(t)+  0  0  u(t) . 

2t_1  J  [o  1. 


(2-42) 


2.2.2.I.2.  Nguyen’s  Second  Canonical  Transformation  for  Single-Input  Systems 

If  the  given  system  is  a  linear  time- varying  uniformly  controllable  single  input  system 


with  a  state  equation  given  by 


x(t)  =  A(t)x(t)  +  b(t)u(t), 


then  ( 2-37)-(  2-40)  reduce  to 


M(t)  =  M(t)  =  [b(t)  Z[b(t)]  -  Z”"1  [b(t)]] , 


(2-43) 


r  Pi,o(o 


F-l /*\  _  Pu(0 


M  (t)  = 


.P,,-,(t) 


(2-44) 


P  —  Pl.n— I  * 


(2-45) 


(2-46) 
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and  ( 2-32)  reduces  to 


2.2.3.  Stabilization  of  Linear  Continuous  Systems 

Stability  is  an  important  qualitative  property  in  control  system  design.  If  a  system  is 
not  stable,  it  is  usually  of  no  practical  use  [6].  It  is  well  known  that  a  time-invariant  system 
is  asymptotically  stable  if  all  of  the  eigenvalues  have  negative  real  parts  [18].  Therefore,  all 
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the  eigenvalues  of  the  given  system  must  be  movable  so  that  the  designer  can  assign  them  to 
the  left  hand  side  of  the  complex  plane.  The  stability  of  a  time-invariant  continuous  system 
can  be  determined  directly  from  the  state  matrix  A(t). 

Various  stability  conditions  have  been  obtained  for  linear  time- varying  continuous 
systems.  Most  of  these  methods  are  difficult  to  use  because  they  depend  on  knowledge  of  the 
state  transition  matrix.  However,  Nguyen  developed  a  stabilization  scheme  that  is  straight¬ 
forward  and  does  not  depend  on  knowledge  of  the  state  transition  matrix  [18].  Nguyen  uses  a 
state  feedback  matrix  to  force  the  closed-loop  feedback  equivalent  system  to  become  a  time- 
invariant  system  having  stable  eigenvalues.  This  stabilization  scheme  uses  a  Lyapunov 
transformation  to  prove  the  asymptotic  stability  of  a  time-invariant  equivalent  system  which 
implies  the  asymptotic  stability  of  its  corresponding  time-varying  original  system.  Nguyen’s 
state  feedback  theorem  for  the  class  of  linear  time- varying  single-input  continuous  systems  is 
presented  below. 

If  the  linear  time-varying  single-input  continuous  system  given  by  ( 2-43)  is  uniformly 
controllable  on  [t0,°°),  then  there  exists  a  state  feedback  law  u(t)=K(t)x(t)  that  will 

asymptotically  stabilize  the  given  system  ( 2-43).  After  applying  the  state  feedback  law,  the 
given  system  can  be  modeled  as 

x(t)  =  [A(t)  +  b(t)K(t)]x(t). 


(2-50) 

If  K(t)  is  chosen  properly,  the  resulting  closed-loop  system  will  be  asymptotically  stable.  An 
algorithm  for  determining  the  required  feedback  matrix  K(t)  is  given  below. 
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Algorithm  2.1 

1)  Apply  Nguyen’s  second  canonical  transformation  to  the  given  linear  time- varying 
single-input  continuous  system.  The  state  and  input  matrices  of  the  equivalent  system  will 
assume  the  following  form, 


ail  ai2 

”•  ain  ” 

A(t)  = 

!  ^(n-l)xl 

and 


(2-51) 


(-1)"'1 

0 

0 


(2-52) 

where  the  coefficients  a,j  for  i  =  1,2,  •  •  • ,  n  are  the  time  varying  parameters  of  ( 2-48). 

2)  Select  the  desired  eigenvalues  X, ,  A2 ,  •  •  • ,  An  and  compute  the  characteristic  equation. 

(A,  —  A.J  )(A  —  A2  )•  •  •  (A,  —  An )  =  A”  +  an_,An  1+-"+a,A  +  a0 


3)  Compute  the  equivalent  feedback  matrix  K(t) . 


^(*)  (_i)n_i  £  au 


4)  Compute  the  equivalent  state  matrix  of  the  closed-loop  feedback  system. 


(2-53) 


(2-54) 
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A(t)  +  b(t)K(t)  = 


-«n-2 

-“o. 

In-,  ! 

1 

®(n-l)xl 

_ 

1 

1 

(2-55) 

Computing  the  eigenvalues  of  ( 2-55)  will  verify  that  the  equivalent  system  possesses  the 
desired  eigenvalues  X, ,  X2 , •  •  • ,  Xn . 

5)  Compute  the  feedback  matrix  K(t). 

K(t)  =  K(t)Q(t) 


(2-56) 

It  is  this  algorithm  which  will  serve  as  part  of  the  baseline  for  the  solution  of  the 
problem  statement  presented  in  Chapter  1. 

2.3.  Linear  Discrete  Systems 

Most  modem  control  systems  are  implemented  through  the  use  of  sampled-data  or 
discrete  methods  which  rely  on  the  use  of  either  a  microprocessor  or  a  digital  signal 
processor.  Sample-and-hold  devices  are  used  extensively  in  modem  control  systems.  A 
sampler  converts  a  given  analog  signal  into  a  pulse-amplitude  modulated  signal  while  a  hold 
device  simply  freezes  the  value  of  the  pulse  for  a  prescribed  duration  of  time  [11].  A  zero- 
order  hold  device  freezes  the  sampled  value  until  the  next  sample  arrives. 

If  a  sample  and  zero-order  hold  is  applied  to  each  input  of  the  continuous  system 
given  in  Figure  2-1,  a  linear  time- varying  multivariable  discrete  system  as  depicted  below  is 
obtained. 
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Ul(t) 

u2(t) 

Up(t) 


Figure  2-2  Linear  Time-Varying  Multivariable  Discrete  System 

The  resulting  discrete  system  can  be  modeled  by  the  following  dynamic  equations, 

x((k  +  1)T)  =  F(k,T)x(kT)  +  G(k,T)u(kT) 


and 


(2-57) 


y(kT)  =  C(kT)x(kT)  +  E(kT)u(kT) , 


(2-58) 

where  x(kT)  is  the  (nxl)  state  vector,  y(kT)  is  the  (qxl)  output  vector,  u(kT)  is  the  (pxl) 
input  vector,  F(k,T)  is  the  (nxn)  state  matrix,  G(k,T)  is  the  (nxp)  input  matrix,  C(kT)  is  the 
(qxn)  output  matrix,  E(kT)  is  the  (qxp)  direct  transmission  matrix,  and  T  is  the  sampling 
period.  The  appearance  of  the  variable  k  in  the  matrices  F(k,T),  G(k,T),  C(kT),  and  E(kT) 
implies  that  these  matrices  are  time- varying.  If  the  variable  k  does  not  appear  in  these 
matrices,  then  the  system  is  assumed  to  be  time-invariant.  For  the  time-invariant  case,  the 
state  equations  simplify  to 

x((k  +  1)T)  =  F(T)x(kT)  +  G(T)u(kT) 


(2-59) 

and 
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y(kT)  =  C(T)x(kT)  +  E(T)u(kT). 


( 2-60) 


2.3.1.  Controllability 

The  concept  of  controllability  plays  an  important  role  in  the  design  of  linear  discrete 
systems.  Controllability  for  this  class  of  systems  can  be  defined  as  follows: 

Definition  2.5  The  linear  discrete  system  given  by  (  2-57)  is  said  to  be  completely 
state  controllable  if  there  exists  a  piecewise-constant  control  vector  u(kT)  defined  over  a 
finite  number  of  sampling  periods  such  that,  starting  from  any  initial  state,  the  state  x(kT) 
can  be  transferred  to  any  desired  state  xf  in  at  most  n  sampling  periods. 

As  is  the  case  with  linear  continuous  systems,  a  controllability  matrix  is  used  to  test 
for  the  condition  of  complete  state  controllability.  The  controllability  matrix  S(T)  of  the 
linear  time-invariant  discrete  system  given  in  ( 2-59)  is  defined  as 

S(T)  =  [G(T)  F(T)G(T)  •••  F"'(T)G(T)]. 


(2-61) 

The  following  theorem  is  used  to  test  for  the  condition  of  complete  state 
controllability  for  the  class  of  linear  time-invariant  discrete  systems  [23]: 

Theorem  2.1  The  linear  time -invariant  discrete  system  given  by  ( 2-59)  is  completely 
state  controllable,  if 


rank[S(T)]  =  n. 


( 2-62) 
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A  controllability  theorem  and  the  associated  controllability  matrix  have  yet  to  be 
developed  for  the  class  of  linear  time- varying  discrete  systems.  Chapter  4  of  this  report  will 
address  the  concept  of  controllability  for  this  class  of  systems. 

2.3.2.  Equivalence  Transformations 

The  use  of  equivalence  transformations  is  an  important  technique  in  the  design  of 
linear  time-invariant  discrete  control  systems.  Several  techniques  exist  to  transform  such 
systems  into  particular  canonical  forms.  The  controllable  canonical,  observable  canonical, 
and  Jordan  canonical  forms  are  the  most  widely  used  methods  available  [25].  Such  methods 
do  not  currently  exist  for  the  class  of  linear  time-varying  discrete  systems.  Chapter  5  of  this 
report  will  address  equivalence  transformations  for  this  class  of  systems. 

2.3.3.  Stabilization  of  Linear  Discrete  Systems 

The  concept  of  stability  is  important  in  the  design  of  linear  time-invariant  discrete 
systems.  Several  stabilization  techniques  exist  to  allow  the  control  system  designer  to 
develop  a  closed-loop  control  system  in  which  the  poles  can  be  arbitrarily  assigned  to  values 
within  the  unit  circle  of  the  complex  plane.  Ackermann’s  formula  [25]  is  one  such  method. 
Such  methods  do  not  currently  exist  for  the  class  of  linear  time-varying  discrete  systems. 
Chapter  5  of  this  report  will  also  address  the  concept  of  stabilization  for  this  class  of  systems. 

2.4.  Conclusion 

This  chapter  presented  relevant  background  information  in  the  area  of  linear  systems 
theory.  Section  2.2  reviewed  the  research  underlying  the  development  of  linear  continuous 
systems.  Section  2.3  presented  relevant  background  information  on  linear  discrete  systems. 


24 


The  concepts  of  controllability,  canonical  transformations,  and  stability  were  presented  in- 
depth  for  the  classes  of  linear  time-invariant  continuous  and  linear  time-varying  continuous 
systems.  A  limited  discussion  of  these  concepts  was  also  provided  for  the  linear  time- 
invariant  discrete  class  of  systems.  The  remainder  of  this  report  focuses  on  developing  these 
concepts  for  the  class  of  linear  time- varying  discrete  systems. 
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CHAPTER  3 

DISCRETIZATION  OF  LINEAR  TIME-VARYING  CONTINUOUS  SYSTEMS 


3.1.  Introduction 

Most  modem  control  systems  consist  of  both  continuous  and  discrete  components. 
The  typical  system  utilizes  continuous  signals  as  inputs  to  a  microprocessor-based  control 
system.  These  continuous  signals  must  be  discretized  (converted  into  discrete  signals)  to  be 
useful  in  the  digital  world  of  the  microprocessor.  Discretization  is  typically  accomplished 
through  the  application  of  a  sample  and  zero-order  hold  device  to  each  continuous  input.  In 
order  to  model  a  discretized  system,  equations  that  define  the  relationship  between  the  given 
continuous  and  the  resulting  discrete  system  must  be  developed. 

3.2.  Problem  Statement 

Equations  must  be  developed  which  model  the  discretization  of  a  linear  time-varying 
multivariable  continuous  system.  The  following  statement  defines  the  specific  problem  to  be 
addressed  in  this  chapter: 

Given  a  discretized  system  which  results  from  the  application  of  a  sample  and  zero- 
order  hold  device  to  each  input  of  a  linear  time-varying  multivariable  continuous 
system,  derive  equations  to  model  the  resulting  discretized  state  equations  (2-57) 
and  (2-58)  in  terms  of  the  associated  continuous  state  equations  (2-2)  and  (2-3). 

The  equations  that  model  the  resulting  discretized  system  are  derived  in  section  3.3. 
These  results  are  illustrated  through  the  use  of  examples  in  section  3.4.  (Note:  A  second 
solution  to  the  above  problem  can  also  be  found  in  Ogata  [25].) 
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3.3.  Derivation  of  the  Discretization  Equations 

The  derivation  of  the  discretization  equations  begins  with  the  solution  to  the  time- 
varying  continuous  system,  given  in  [24]  as 

t 

x(t)  =  3>(t,t0)x0  +  J  <I>(t,x)B(x)u(x)dx . 


(3-1) 

Since  the  inputs  u(t)  are  the  outputs  of  the  zero-order  hold  devices, 

u(t)  =  u(kT) 

(3-2) 

for  kT<t<(k+l)T.  Note  that  the  initial  condition  at  the  beginning  of  the  interval  [kT,(k+l)T] 


x0  =  x(lo)  =  x(kT) 


To  determine  x(t)  at  the  end  of  the  interval  [kT,(k+l)T],  substitute  ( 3-2), ( 3-3), 

t0  =  kT , 


(3-3) 


(3-4) 


t  =  (k  +  l)T, 


(3-5) 


into  (3-1).  This  yields 
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i 

x((k  +  l)T)  =  0((k  +  l)T,kT)x(kT)  +  J  <D((k  +  l)T,x)B(x)u(x)dx. 


(3-6) 


Since  the  input  is  constant  between  any  two  consecutive  sampling  periods,  the  input  vector 


has  the  following  property 


u(x)  =  u(kT), 


(3-7) 


for  kT<x<(k+l)T.  Substituting  ( 3-7)  into  ( 3-6)  yields 


VK-ri;  i 

x((k  +  1)T)  =  <D((k  +  l)T,kT)x(kT)  +  J  G>((k  +  l)T,x)B(x)dx  u(kT) 


(3-8) 


A  comparison  of  (  3-8)  and  (2-57)  shows  that  the  discrete  state  matrix  can  be  defined  as 

F(k,T)  =  <D((k+l)T,kT) 


(3-9) 


and  the  discrete  input  matrix  can  be  defined  as 


y«.-r  if  m 

G(k,T)  =  J  <D((k  +  1)T, x)B(x)dx . 


(3-10) 


The  discretized  output  equation  (2-58)  is  derived  by  substituting  t=(kT)  into  the  continuous 
output  equation  (2-3).  The  resulting  output  and  direct  transmission  matrices  are  defined  as 

C(kT)  =  [C(t)]t=kT 


(3-11) 
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and 


E(kT)  =  [E(t)],,„. 

( 3-12) 

Equations  ( 3-9)-(  3-12)  are  referred  to  as  the  discretization  equations.  These 
equations  define  the  resulting  linear  time-varying  discrete  system  after  the  application  of 
sample  and  zero-order  hold  devices  to  the  inputs  of  a  linear  time-varying  multivariable 
continuous  system.  It  should  be  noted  that  the  discretization  equations,  (  3-9)  and  (  3-10),  are 
dependent  on  the  state  transition  matrix  of  the  continuous  system.  In  other  words,  the 
resulting  discrete  system  can  only  be  modeled  if  the  state  transition  matrix  of  the  continuous 
system  can  be  computed.  It  can  also  be  shown  that  the  discretization  equations  derived  here 
are  equivalent  to  those  in  [25]. 

3.4.  Examples 

The  following  examples  are  used  to  illustrate  the  concepts  of  lexicografixed 
controllability  and  the  discretization  of  linear  time-varying  continuous  systems.  Each 
example  begins  with  a  given  linear  time- varying  continuous  system.  The  property  of 
lexicografixed  controllability  is  then  tested.  If  the  test  shows  that  the  given  system  is  not 
lexicografixed  controllability  then  a  sample  and  zero-order  hold  is  applied  to  each  input  and 
the  dynamic  equations  of  the  resulting  discrete  system  are  computed  using  ( 3-9)-(  3-12).  A 
step-by-step  approach  delineates  the  procedure  necessary  to  discretize  a  given  system.  The 
Maple  code  used  to  solve  these  examples  is  included  in  Appendix  A. 
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3.4.1.  Example  3-1: 


Consider  a  linear  time-varying  single-input-single-output  continuous  system  with 
dynamic  equations  given  as 


x(t)  = 


-1  exp(-2t) 
0  -1 


x(t)  + 


1 

exp(l-t) 


u(t) 


(3-13) 


and 


y(t)  =  [  exp(-2t)  -1]  x(t)  +  u(t) . 

(3-14) 

a)  Check  to  see  if  the  given  system  is  lexicografixedly  controllable.  From  (2-18),  the 
controllability  matrix  can  be  computed  as 

M(t)  =  [Mj  (t)  M2(t)], 


(3-15) 


where 


M,(t)  =  B(t) 


-[  1  I 

|_exp(l-t)_ 


(3-16) 


and 


M2(t)  =  -  A(t)B(t)  +  —  B(t)  = 
dt 


l-exp(l-3t) 

0 


(3-17) 


Substituting  (3-16)  and  (3-17)  into  (3-15)  yields 
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M(t)  = 


1  l-exp(l-3t)~ 
exp(l-t)  0 

Computing  the  determinant  of  (3-18)  yields, 

Mdct  (t)  =  exp(2  -  4t)  -  exp(l  - 1) . 

Equation  (  3-19)  is  plotted  below. 


(3-18) 


(3-19) 


Figure  3-1  Determinant  as  a  function  of  time 

Figure  3-1  shows  that  the  determinant  of  M(t)  is  zero  for  t=0.333  seconds.  Therefore,  from 
definition  2.3,  the  system  is  not  lexicografixedly  controllable. 

b)  Check  to  see  if  the  state  matrix  satisfies  the  commutative  property.  Solving  (2-8) 
yields 
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A(t) 


i 

J  A(x)dx 


L'o 


l 

J  A(x)dx 


L  'o 


t-t„ 


A(t) 


—  ~  t  +  t„ 


0 


exp(-2t)-^exp(-2t0) 

jL 

t-tn 


( 3-20) 

Based  on  ( 3-20),  it  is  obvious  that  the  state  matrix  satisfies  the  commutative  property, 
c)  Compute  the  state  transition  matrix.  Since  A(t)  satisfies  the  commutative  property, 
the  state  transition  matrix  is  computed  directly  from  (2-9). 


O(t,t0)  =  exp 

t 

f  A(x)dx 

=  exp 

-t  +  t0  |exp(2t)-|exp(2t0) 

.  *0 

- 1 

o 

•4—t 

+ 

1 

o 

exp(-  t  + 10 )  |exp(-t  - 10 )  -  ^exp(-3t  + 10 ) 
0  exp(-t  +  t0) 


(3-21) 

d)  Assume  that  a  sample  and  zero-order  hold  is  applied  to  the  input  of  the 
continuous  system.  Use  the  discretization  equations  to  model  the  resulting  discrete 
system.  From  (  3-9),  the  discretized  state  matrix  is  computed  as 


F(k,T)  =  0((k  +  l)T,kT)  = 


exp(-  T)  |exp(-(l  +  2k)T)  -  ^exp(-(3  +  2k)T) 
0  exp(-  T) 


( 3-22) 


and  from  (3-10)  the  discretized  input  matrix  is  computed  as 
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(k+I)T 


G(k,T)  =  J  <D((k  +  l)T,x)B(x)dx 


kT 


--  -  ^Tjexp(l  -  3kT  -  3T)+ 1  -  exp(-T)+-j-exp(l  -  3kT  -  T) 
Texp(l-kT-T) 


( 3-23) 

From  (3-11)  and  (  3-12)  the  discrete  output  and  direct  transmission  matrices  are  computed  as 

C(kT)  =  [exp(-2kT)  -l] 


(3-24) 


and 


E(kT)  =  1 . 


( 3-25) 


The  dynamic  equations  of  the  resulting  system  can  be  obtained  by  substituting 
( 3-22)-(  3-25)  into  (2-57)  and  (2-58). 

3.4.2.  Example  3-2: 

Consider  a  linear  time-varying  multivariable  continuous  system  with  dynamic 
equations  given  as 


x(t)  = 


exp(- 1)  0 

0  exp(-  t)J 


x(t)  + 


1  1 
1  1 


u(t) 


(3-26) 


and 


y(t)  =  [t  l]x(t)  +  [t  l]  u(t) . 


( 3-27) 
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a)  Check  to  see  if  the  given  system  is  lexicografixedly  controllable.  From  (2-18),  the 
controllability  matrix  can  be  computed  as 

M(t)  =  [Mj  (t)  M2(t)], 


where 


( 3-28) 


M,(t)  =  B(t)  = 


1  1 
1  1. 


and 


( 3-29) 


11  dll 
1  1J+  dt  Ll  1. 

-exp(-t)  -exp(-t) 
exp(-  t)  -  exp(-  t)J  * 


M2(t)  =  —  A(t)B(t)  +  —  B(t)  =  — 

dt 


exp(- 1)  0 

0  exp(- 1). 


Substituting  ( 3-29)  and  (  3-30)  into  ( 3-28)  yields 


M(t) 


1  1  -  exp(—  t)  -  exp(-  t) 
.1  1  -  exp(-  t)  -  exp(-  t)_ 


( 3-30) 


(3-31) 

From  ( 3-31)  it  is  obvious  that  the  determinant  of  M(t)  is  zero  for  all  t.  Therefore  M(t)  does 
not  have  full  rank  and  the.given  system  is  not  lexicografixedly  controllable. 

b)  Check  to  see  if  the  state  matrix  satisfies  the  commutative  property  of  (2-8). 

Since  A(t)  is  a  diagonal  matrix,  it  satisfies  the  commutative  property  [  6]. 

c)  Compute  the  state  transition  matrix.  Since  A(t)  satisfies  the  commutative  property, 
the  state  transition  matrix  is  computed  directly  from  (2-9). 
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O(t,t0)  =  exp 


i 

J  A(x)dt 


L'o 


exp  (-  exp(-  t)  +  exp(-  t0 ))  0 

0  exp  (-  exp(- 1)  +  exp(- 10 )) 


( 3-32) 

d)  Assume  that  a  sample  and  zero-order  hold  is  applied  to  each  input  of  the 
continuous  system.  Use  the  discretization  equations  to  model  the  resulting  discrete 
system.  From  (3-9),  the  discretized  state  matrix  is  computed  as 
F(k,T)  =  0>((k  +  l)T,kT) 

exp  (-exp(-  (k+  l)T)  +  exp(-  kT))  0 

0  exp  (-  exp(-  (k  +  l)T)  +  exp(-  kT)) 


and  from  ( 3-10)  the  discretized  input  matrix  is  computed  as 


G(k,T) 


(k+l)T 

J  0((k+l)T,x)B(x)dT  = 

kT 


«(k,T) 

a(k,T) 


oc(k,T)‘ 

a(k,T) 


( 3-33) 


(3-34) 


where 


a(kjTx  =  Ei(l,-exp(-(k  +  1)T))  -  Ei(l -exp(-kT)) 
exp(exp(-(k  +  l)T)) 


( 3-35) 


and  the  function  Ei(n,x)  is  defined  in  [  14]  as 


00  cxd( _ xl  i 

Ei(n,  x)  =  J - p — 4lt  for  Re(x)  >  0 . 


( 3-36) 

From  (3-11)  and  (3-12)  the  discrete  output  and  direct  transmission  matrices  are  computed  as 
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C(kT)  =  [kT  l] 


and 


( 3-37) 


E(kT)  =  [kT  1], 

( 3-38) 

The  dynamic  equations  of  the  resulting  system  can  be  obtained  by  substituting 
(  3-33)-(  3-38)  into  (2-57)  and  (2-58). 

3.4.3.  Example  3-3: 

Consider  a  linear  time-varying  multivariable  continuous  system  with  state  equation 
given  by 

x(t)  = 


2-4  exp(-  2t)  0 
0  1 

0  0 


0 

0 

3t  + 1 
2(t  +  l) 


'l  o' 

x(t)  + 

1  1 

0  1_ 

u(t). 


( 3-39) 

a)  Check  to  see  if  the  given  system  is  lexicografixedly  controllable.  From  (2-18),  the 
controllability  matrix  can  be  computed  as 

M(t)  =  [M,(t)  M2(t)  M3(t)], 

(3-40) 
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where 


M,(t)  =  B(t)  = 


1  0 
1  1 
0  1 


(3-41) 


M2(t)  =  - A(t)B(t)  +  — B(t)  = 
at 


2  +  4exp(-2t)  0 

-1  -1 

-(3t-l) 


0 


2(t+l)J 


and 


(3-42) 


M3(t)=-A(t)Q2(t)  +  -Q2(t)  = 


£ 

dt 


-  24  exp(-  2t)^ 

*+  16exp(-  4t) 

1 

0 


( 


0 

1 


9t  -  6t  -  7 


4(t  +  l)5 


Substituting  ( 3-41),  ( 3-42),  and  ( 3-43)  into  ( 3-40)  yields 


M(t)  = 


I  0  -2  +  4  exp(-  2t) 

II  -1 

0  1  0 


0 

-  1 

-3  1 

-yt+2 

t  + 1 


4-  24  exp(-  2t) 

+  16exp(-  4t) 

1 

0 


(3-43) 


0 

1 

9t2  —  6t  —  7 
4(t+l)2  , 


(3-44) 
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This  system  is  lexicografixedly  controllable  if  the  determinant  of  any  matrix  consisting  of  any 
combination  of  any  three  column  vectors  of  M(t)  is  non-zero  for  all  time  t  [21].  There  are  20 
matrices  that  can  be  formed  which  consist  of  three  column  vectors  of  M(t).  Since  the 
determinants  of  all  20  matrices  were  found  to  be  non-zero  for  all  t,  the  system  is  not 
lexicografixedly  controllable  in  continuous  time. 

b)  Check  to  see  if  the  state  matrix  satisfies  the  commutative  property  of  (2-8). 

Since  A(t)  is  a  diagonal  matrix,  it  satisfies  the  commutative  property  [  6]. 

c)  Compute  the  state  transition  matrix.  Since  A(t)  satisfies  the  commutative  property, 
the  state  transition  matrix  is  computed  directly  from  (2-9). 


O(t,t0)  =  exp 


J  A(T)dx 


L‘o  J 

f2t  + 2exp(- 2t)  ^ 


exp 


2t0  -  2exp(-  2t0)J 


0 

0 


0 


exp(t-t0) 


0 


(to  +  1)2 
(t+1)2 


0 

0 

expl 


3  3  ^ 

-t--tn 

.2  2  °J 


( 3-45) 

d)  Assume  that  a  sample  and  zero-order  hold  is  applied  to  each  input  of  the 
continuous  system.  Use  the  discretization  equations  to  model  the  resulting  discrete 
system.  From  ( 3-9),  the  discretized  state  matrix  is  computed  as 
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F(k,T)  =  0((k+l)T,kT) 

J 2exp(-  2(k  +  1)T)  ^ 
+2T-  2exp(-  2kT) 


exp 


0 

0 


0 

exp(T) 

0 


0 

0 


(kT+1)2 

(kT+T+1) 


>  exp(lT) 


and  from  (3-10)  the  discretized  input  matrix  is  computed  as 


G(k,T) 


(k+l)T 

J  0((k+l)T,x)B(x)dx  = 

kT 


goo(T) 
exp(T)  - 1 
0 


0 

exp(T)  - 1 
8*0)  . 


where 


(3-46) 


(3-47) 


goo(T)  =  jexp(2(k  +  l)T)-i-ex 
4  2 


p(-  exp(-2kT)  +  kT  +  T  +  exp(-2(k  +  1)T)) 


(3-48) 


and 


2(30kT  +  29  +  9k2T2 )  J 3  ^  2(-30kT  -  9T2  -  29  -  9k2T2  -  18kT2  -  30T) 

g2i  (4)  ■  3  rT  4"  -  - - . 

27(kT  +  T+l)  U  J  27(kT  +  T+l)2 


(3-49) 

The  state  equation  of  the  resulting  system  can  be  obtained  by  substituting  (  3-46)-(  3-47)  into 
(2-57). 
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3.5.  Conclusion 


Linear  time-varying  continuous  systems  are  discretized  through  the  application  of  a 
sample  and  zero-order  hold  to  each  input  of  the  system.  Equations  modeling  the  resulting 
discrete  system  are  derived  in  section  3.3.  These  results  show  that  the  discrete  model  is 
dependent  on  the  state  transition  matrix  of  the  given  continuous  system.  That  is,  if  the  state 
transition  matrix  of  a  continuous  system  can  be  computed,  then  a  discretized  system  can  be 
modeled  through  the  application  of  the  discretization  equations  derived  in  this  chapter.  The 
discretization  process  was  successfully  demonstrated  in  section  3.4  through  the  use  of  several 
examples. 
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CHAPTER  4 

CONTROLLABILITY  OF  LINEAR  TIME- VARYING  DISCRETE  SYSTEMS 

4.1.  Introduction 

The  property  of  controllability  deals  with  the  existence  of  a  control  vector  that  can 
cause  the  system’s  state  to  reach  some  arbitrary  state  [25]  in  a  finite  period  of  time.  A  given 
system  must  possess  the  property  of  controllability  if  state  feedback  and  stabilization 
techniques  are  to  be  used  to  control  the  system.  For  linear  continuous  systems,  these 
techniques  rely  heavily  on  the  continuous  controllability  matrix  (2-18)  which  is  defined  for 
both  time-invariant  and  time-varying  continuous  systems.  For  discrete  systems,  these 
techniques  rely  heavily  on  the  discrete  controllability  matrix  (2-61)  which  is  defined  only  for 
the  time-invariant  discrete  class  of  systems.  However,  in  the  case  of  linear  time-varying 
discrete  systems,  a  controllability  matrix  has  not  yet  been  defined.  Consequently,  state 
feedback  and  stabilization  techniques  do  not  exist  for  this  class  of  systems. 

4.2.  Problem  Statement 

In  order  to  develop  state  feedback  and  stabilization  techniques  for  linear  time- varying 
discrete  systems,  a  controllability  theorem  and  its  corresponding  controllability  matrix  must 
be  developed.  The  following  statement  defines  the  specific  problem  to  be  solved  in  this 
chapter: 

Given  definition  2.5  which  describes  the  concept  of  complete  state  controllability  for 
linear  discrete  systems,  derive  a  controllability  matrix  and  develop  a  controllability 
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theorem  which  can  be  used  to  test  for  the  condition  of  complete  state 
controllability. 

A  controllability  matrix  for  this  class  of  systems  is  derived  and  the  associated 
controllability  theorem  is  developed  in  section  4.3.  These  results  are  illustrated  through  the 
use  of  examples  in  section  4.4. 


4.3.  Controllability  Matrix  and  Theorem  for  the  Class  of  Linear  Time-Varying 

Discrete  Systems 

In  this  section  a  new  controllability  theorem  for  linear  time- varying  multivariable 
discrete  systems  is  introduced  and  its  associated  controllability  matrix  is  derived.  These 
results  represent  advances  in  the  theory  of  the  control  of  linear  discrete  systems. 

Using  definition  2.5  which  defines  complete  state  controllability  for  linear  discrete 
systems,  a  necessary  and  sufficient  condition  for  the  complete  state  controllability  of  a  linear 
time-varying  multivariable  discrete  system  is  derived.  The  derivation  begins  by  finding  the 
solution  to  the  discrete  state  equation  (2-57). 

The  solution  of  (2-57)  can  be  found  by  recursion,  as  follows: 

For  k=0, 


x(T)  =  F(0,T)x(0)  +  G(0,T)u(0) . 


For  k=l, 


(4-1) 


x(2T)  =  F(l,T)F(0,T)x(0)  +  F(l,T)G(0,T)u(0)  +  G(l,T)u(T). 


For  k=2, 


(4-2) 
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(4-5) 

The  solution  to  the  state  equation  (2-57)  at  the  nth  sampling  period  can  be  obtained  by 

substituting  k=n  into  ( 4-5).  This  yields 

x(nT)  =  [F(n  -  l,T)F(n  -  2,T). . .  F(0,T)]x(0) 

+  X  -Jo  [[F(n-  l,T)F(n-  2,T)...F(j  +  l,T)]G(jT)u(jT). 


(4-6) 

Rewriting  ( 4-6)  yields 

x(nT)  -  [F(n  -  l,T)F(n  -  2,T)...F(0,T)]x(0) 

=  X "=’d  [F(n- l,T)F(n-2,T)...F(j  +  l,T)p(j,T)u(jT) 

=  [F(n  -  l,T)F(n  -  2,T)..  .F(l,T)]G(0,T)u(0) 

+[F(n  -  l,T)F(n  -  2,T).  ..F(2,T)]G(l,T)u(T) 

+[F(n  -  l,T)F(n  -  2,T). .  .F(3,T)]G(2,T)u(2T) 
+...+G(n-l,T)u((n-l)T) 


which  can  be  written  in  matrix  form  as  follows, 


(4-7) 
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x(nT)  -  [F(n  -  1,  T)F(n  -  2,  T). . .  F(0,  T)]x(0) 

G(n  -  1,T)  IT  u((n  -  1)T)~ 

F(n  -  1,  T)G(n  -  2,  T)  u((n  -  2)T) 

_[F(n-  l,T)F(n-  2,T)... F(1,T)]G(0,T)J  [_  u(0)  . 


(4-8) 


The  controllability  matrix  S(T)  for  the  class  of  linear  time-varying  multivariable  discrete 
systems  is  now  defined  as 


S(T)  = 


G(n  -  1,T)  T 

F(n  -  1,  T)G(n  -  2,  T) 

_[F(n  -  1,  T)F(n  -  2,  T). . .  F(l,  T)]G(0,  T). 


In  compact  form,  the  controllability  matrix  ( 4-9)  can  be  written  as 

S(T)  =  [S0(T)  S,(T)  ...  Sn_, (T)], 


where 


S0(T)  =  G(n-  1,T), 


Ss(T)=  F[  F(n-  j,T)  G(n-  1- i,T). 

.  j=i 


(4-9) 


(4-10) 


(4-11) 


(4-12) 


Since  the  input  matrix  G(k,T)  is  an  (nxp)  matrix,  each  of  the  matrices 
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S0(T),Sj(T),...,Sn  j(T)  of  ( 4-10)  is  an  (nxp)  matrix.  Therefore,  the  controllability  matrix 

S(T)  is  an  (nxnp)  matrix.  For  time-invariant  discrete  systems,  the  time-varying  controllability 
matrix  ( 4-10)  reduces  to  the  time-invariant  controllability  matrix  (2-61). 

A  new  controllability  theorem  will  now  be  introduced  and  subsequently  proven. 

Theorem  4.1 

The  state  equation  (2-57)  of  a  linear  time-varying  multivariable  discrete  system  is 
completely  state  controllable,  if  and  only  if  the  rank  of  the  (nxnp)  controllability 
matrix  is  n  at  some  sampling  period  T. 

To  prove  the  necessity  of  theorem  4.1,  assume  that  the  state  equation  is  state 
controllable  and  then  show  that  the  controllability  matrix  has  full  rank.  The  state  transition 
equation  of  the  discrete  system  can  be  obtained  by  substituting  ( 4-9)  into  ( 4-8). 

x(nT)  -  [F(n  -  l,T)F(n  -  2,T)...  F(0,T)]x(0)  =  S(T 

L  u(0)  J 

(4-13) 

If  the  left  hand  side  of  (4-13)  is  represented  as  an  (nxl)  vector  X(nT)  then  (4-13)  can  be 
written  as 

X(nT)  =  S(T)U(nT). 


"u((n  -  1)T) 
u((n  -  2)T) 


(4-14) 

From  definition  2.5,  if  the  system  is  assumed  to  be  completely  state  controllable,  then 
every  initial  state  X(0)  can  be  transferred  by  unconstrained  controls  U(nT)  to  any  final  state 
X(nT)  in  a  finite  number  of  sampling  periods.  Thus  the  problem  can  be  reduced  to  the 
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following:  Given  S(T)  and  every  vector  X(nT)  in  the  n-dimensional  state  space,  solve  for  the 
controls  U(nT).  Since  ( 4-14)  represents  n  simultaneous  linear  equations,  these  equations 
must  be  linearly  independent  for  solutions  to  exist.  The  controllability  matrix  S(T)  must, 
therefore,  have  full  rank  (equal  to  n)  for  solutions  to  exist.  Necessity  has  been  proven. 

Contradiction  is  used  to  prove  the  sufficiency  of  the  theorem.  Assume  that  the 
controllability  matrix  does  not  have  full  rank  and  that  the  system  is  completely  state 
controllable.  If  the  controllability  matrix  does  not  have  full  rank,  then,  from  the  theory  of 
linear  equations,  S(T)  does  not  have  n  linearly  independent  column  vectors.  If  S(T)  does  not 
have  at  least  n  linearly  independent  column  vectors,  then,  given  X(nT)  and  U(nT),  the  set  of 
simultaneous  linear  equations  ( 4-14)  cannot  be  solved.  This  means  that  unconstrained 
controls  capable  of  transferring  every  initial  state  X(0)  to  any  final  state  X(nT)  cannot  be 
found.  This  contradicts  the  assumption  that  the  system  is  completely  state  controllable. 
Sufficiency  has  been  proven.  Consequently,  the  full  rank  condition  given  in  theorem  4.1  is 
found  to  be  both  a  necessary  and  sufficient  condition  for  complete  state  controllability.  The 
proof  is  complete. 

4.4.  Examples 

The  following  examples  are  used  to  illustrate  Theorem  4.1  and  its  corresponding 
controllability  matrix.  The  Maple  code  used  to  solve  these  examples  is  included  in 
Appendix  A. 


46 


4.4.1.  Example  4-1: 


Consider  a  linear  time-varying  single-input-single-output  discrete  system  with  state 
and  input  matrices  given  by  (3-22)  and  (3-23). 

a)  Compute  the  controllability  matrix  of  the  given  system.  From  (4-10),  the 
controllability  matrix  can  be  computed  as 


S(T)  = 


1  -(1+1] 

U  2) 

exp(l-6T) 

('  .  .  exp(l-4T)  . 

exp(-T) - ^ - L  -  exp(-2T) 

-exp(-T)-t 

exp(l-4T) 

A 

exp(l  -  2T)  T  exp(l  -  6T) 

A  A 

Texp(l-2T)  Texp(l-2T) 


(4-15) 

b)  Determine  whether  the  given  system  is  completely  state  controllable.  Computing 
the  determinant  of  the  controllability  matrix  (4-15)  yields, 

S^T)  =  Texp(l-2T)+Texp(l-4T)-^£z£l) 

-Te^-8T).2Texp(l_3T)+Lexp(2  — 6T) 


(4-16) 

Theorem  4.1  states  that  a  given  discrete  system  is  completely  state  controllable  if  and  only  if 
the  controllability  matrix  has  full  rank.  It  is  well  known  that  a  matrix  which  is  dependent  on 
the  variable  T  has  full  rank  at  values  of  T  for  which  the  determinant  is  non-zero.  Plotting 
(4-16)  as  a  function  of  the  sampling  period  T  yields  the  graph  depicted  in  Figure  4-1. 
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Figure  4-1  Determinant  as  a  Function  of  Sampling  Period  (Example  4-1) 

Figure  4-1  shows  that  the  value  of  Sdet(T)  crosses  the  zero  axis  (i.e.,  equals  exactly 
zero)  at  two  values  of  T  and  also  approaches  zero  as  T  increases.  Solving  (4-16)  shows  that 
Sdet(T)=0,  and  the  system  is  therefore  uncontrollable,  for  sampling  periods  of  T=0  and 
T=0.343  seconds.  Theoretically,  the  system  is  controllable  at  any  other  sampling  period. 
However,  choosing  a  sampling  period  at  which  Sdet(T)  is  very  close  to  zero  is  undesirable 
because  the  inverse  of  Sdet(T)  would  then  approach  infinity  and  the  system  would  be  ill- 
defined.  For  practical  purposes  it  is  desirable  to  select  a  sampling  period  such  that 

(D  >|l0‘3| .  Using  this  criteria,  the  range  of  acceptable  sampling  periods  can  be  computed 
as 

0.08  <  T  <  0.33  seconds 
0.35  <  T  <  4.72  seconds. 

(4-17) 

c)  Demonstrate  that  the  given  system  is  completely  state  controllable.  Assume  a 
sampling  period  of  T=0.5  seconds,  an  initial  state  at  k=0  of 
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x0(0)]  [2.0* 

x,  (0)  J  |_5.oJ’ 


and  a  desired  state  at  k=n=2  of 

'x0  (2)1  [05 

_x,(2)J  [25 


At  a  sampling  period  of  T=0.5  seconds,  the  state  equation  becomes 

*x0(k  + 1)1  _  1*0.6065306597  0.1917002498exp(-k)l[x0(k)‘ 
_x,(k  +  l)J  [  0  0.6065306597  J[x,(k)_ 

I* 0.1089 14879  exp(-15k)+ 0.3934693403] 

+  0.8243606355 exp(-05  k)  °(k)‘ 


Substituting  k=0  into  ( 4-20)  yields, 

*x0(l)l  _  [2.171562568  +  05023843282  u(0)" 
_x,  (1) J  “  [3.032653299  +  0.8243606355 u(0)_ ' 


(4-18) 


(4-19) 


( 4-20) 


(4-21) 

Substituting  k=l  into  ( 4-20)  yields 

x0  (2)1  _  [  1530989814  +  0.3628475375  u(0)  +  0.41777 15590  u(l)' 
x,  (2) J  “  [  1.839397206  +  05000000001  u(0)  +  05000000001  u(l)  ' 


(4-22) 

By  substituting  (4-19)  into  ( 4-22)  and  then  solving  the  resulting  set  of  simultaneous  linear 
equations,  it  can  be  shown  that  the  control  vector 
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'u(O)' 

'  28.82075800 ' 

_U(1) 

-27.4995524 1_ 

(4-23) 

will  produce  the  desired  state  ( 4-19).  Hence,  by  definition  2.5  the  given  discrete  system  is 
completely  state  controllable. 

4.4.2.  Example  4-2: 

Consider  a  linear  time-varying  multiple-input  discrete  system  with  state  and  input 
matrices  given  by  (3-33)  and  (3-34). 

a)  Compute  the  controllability  matrix  of  the  given  system.  From  ( 4-10),  the 

controllability  matrix  can  be  computed  as 

r<x(T)  <x(T)  P(T)  P(T)" 

(  }  L«(T)  a(T)  P(T)  P(T)j 


(4-24) 


where 


a(T)  = 


Ei(l,-exp(-2T))  -  Ei(l,-exp(-T)) 
exp(exp(-2T) 


(4-25) 


and 


P(T)  =  (Ei(l,-exp(-T))  -  Ei(l,-l))exp(-exp(-T))exp(-exp(-2T)-l-  exp(-T)) . 


(4-26) 
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b)  Determine  whether  the  given  system  is  completely  state  controllable.  By 
inspection  of  ( 4-24),  it  is  obvious  that  the  determinant  of  the  controllability  matrix  equals 
zero  for  all  sampling  periods.  Hence,  the  discrete  system  is  not  completely  state  controllable. 


4.4.3.  Example  4-3: 

Consider  a  linear  time-varying  multiple-input  discrete  system  with  state  and  input 
matrices  given  by  (3-46)  and  (3-47). 

a)  Compute  the  controllability  matrix  of  the  given  system.  From  (4-10),  the 
controllability  matrix  can  be  computed  as 


SOo.o 

S00, 

Sl0.o 

Sl0, 

S20>0 

S20ll 

S(T)  = 

SOl.0 

sou 

Sl,0 

si,, 

S21>0 

S2U 

.SO2i0 

so2>1 

^^2,0 

S12,1 

S22,o 

S22iI. 

where  the  matrix  elements  of  S(T)  are  given  as 


S00,0  =  ^-exp(6T)  -  ^-exp(-2exp(-4T)  +  6T + 2  exp(-6T)), 


S010  =S0,,  =  exp(T)  - 1, 


S^2,o  —  S00 ,  —  Sl01  —  Sl20  —  S220  —  S201  —  0, 


(4-27) 


(4-28) 


(4-29) 


(4-30) 
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S0W  = 


(72T2  +  120T  +  58)exp^y  J  -  2(8  IT2  +  90T  +  29) 
27 (3T  + 1)2 


(4-31) 


1  (2T+2exp(-6T)Y  f-2exp(-2T)  +  4T 

S 1 0  0  =  —  exp  exp(4T)  -  exp 

0,0  4  *\-2exp(-4T)  Jl  F  Fl+2exp(-4T) 


Sli,0  =  SI, ,  =  exp(T)(-l  +  exp(T)), 


(4-32) 


(4-33) 


2exp  -T  I ,  (  \  \ 

S4  =  27(3T  + 1)  [K  +30T+29)exp^Tj-(36T2  +  60T+29)J, 


(4-34) 


S200  =  j  (exp(2T)  -  exp(-2  +  2T  +  2  exp(-2T)))exp(4T  +  2  exp(-6T)  -  2  exp(-2T)) , 


(4-35) 


S2li0  =  S2, ,  =exp(2TX-l  +  exp(T)), 


(4-36) 


-2exp(3T) 


27  (3T  + 1) 


S2, ,  = - 9T2  +  30T  +  29-29 exp  -T 

r\~ifr\rry  .  -*\2  I  r% 


(4-37) 


(b)  Determine  whether  the  given  system  is  completely  state  controllable.  Theorem 


4.1  states  that  a  given  discrete  system  is  completely  state  controllable  if  and  only  if  the 


52 


controllability  matrix  has  full  rank.  Since  ( 4-27)  is  a  (3x6)  matrix,  the  controllability  matrix 
has  full  rank  at  values  of  T  for  which  the  determinant  of  any  (3x3)  sub-matrix  is  non-  zero.  A 
(3x3)  sub-matrix  is  formed  by  taking  the  first  three  column  vectors  of  ( 4-27). 

S00,0  S0W  S1q0 
S„,(T)=  S0,„  SO,,  Sl,„ 

.S02,o  S0W  Sl2i0. 


Computing  the  determinant  of  ( 4-38)  yields, 

Sde'(T)  =  ^3T+^  -BIT2  -90T-29  +  (36T2  +60T  +  29)exp^|lj 

-exp(7T)  +  exp(7T  -  2exp(4T)  +  2exp(6T)) 

+ exp(-2  exp(4T)  +  6T  +  2  exp(6T)) 

-  exp(6T  +  2  exp(-6T)  -  2  exp(-2T)) 


(4-38) 


(4-39) 

Plotting  (4-39)  as  a  function  of  the  sampling  period  T  yields  the  graph  depicted  in  Figure  4-2. 


Figure  4-2  Determinant  as  a  Function  of  Sampling  Period  (Example  4-3) 
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Figure  4-2  shows  that  the  value  of  Sdet(T)  crosses  the  zero  axis  (i.e.,  equals  exactly 
zero)  at  two  values  of  T  and  approaches  infinity  as  T  increases.  Solving  ( 4-39)  shows  that 
Sdet(T)=0,  and  the  system  is  therefore  uncontrollable,  at  sampling  periods  of  T=0  and 
T=0.363  seconds.  Theoretically,  the  system  is  controllable  at  any  other  sampling  period. 
However,  choosing  a  sampling  period  at  which  Sdet(T)  is  very  close  to  zero  or  infinity  is 
undesirable  because  the  inverse  of  Sdet(T)  would  then  approach  infinity  or  zero,  respectively, 
and  the  system  would  be  ill-defined.  For  practical  purposes  it  is  desirable  to  select  a 
sampling  period  such  that  |l(T3  <S(fet(T)<|l06  .  Using  this  criteria,  the  range  of  acceptable 

sampling  periods  can  be  computed  as 

0.17  <  T  <  0.35  seconds 
0.37  <  T  <  2.40  seconds. 

( 4-40) 

c)  Demonstrate  that  the  given  system  is  completely  state  controllable.  Assume  a 
sampling  period  of  T=0.5  seconds,  an  initial  state  at  k=0  of 

'x0(0)l  f2J0“ 
x,(0)  =  5.0  , 

_x2(0)J  [L0_ 

(4-41) 


and  a  desired  state  at  k=n=3  of 


x0(3)  05 

x,  (3)  =  2.5  . 
x2  (3)  0 


At  a  sampling  period  of  T=0.5  seconds,  the  state  equation  becomes 

x(k  + 1)  =  F(k)  x(k)  +  G(k)  u(k) , 


where 


exp(l  +  2exp(-k  -  l)-2exp(-l 
0 


(4-42) 


(4-43) 


1.648721271  0 

(k  +  2)2 

0  2.117000017- - ;-r 

(k  +  3)2 


(4-44) 


G(k)  = 


0.6795704570exp(k) 

(l  -  exp(- 1.26424 1118  exp(-k))) 


0.648721271 


0.648721271 

0.1861666695k2  +  0.907777797k 
+1.12170374 

0.25k2  +  15k +  2.25 


Substituting  k=0  into  ( 4-43)  yields, 


(4-45) 
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'Xo(l)' 

1.535576779  +  0.4876233596u0(0) 

X,(l) 

= 

8.243606355+ 0.64872127l(u0(0)  +  u,  (0)) 

_X2  (!)_ 

0.9408888964 +  0.4985349956u,  (0) 

( 4-46) 

Substituting  k=l  into  ( 4-43)  yields, 


x0(2)" 

2.621686325  +  0.8325 18 1203u0  (0)  +  0.687035 1 13u0  (1) 

x,(2) 

= 

1359140915+  1.069560558(u0(0)  +  u,  (0))+  0.64872127l(u0(l)  +  u,  (1)) 

x2(2)_ 

1.120422268  +  059366 17094u,  (0)  +  055391205 16u,  (1) 

(4-47) 

Substituting  k=2  into  ( 4-43)  yields, 

'  6.005773861  + 1.9071 372 18uo(0)  +  1573863922u0(l)  +  0.789661357uo(2)  ' 
^22.40844537  +  1.763407243(uo  (0)  +  u,  (0))  "j 

<+1.069560558(uo(l)  +  u1(l))+0.64872127l(uo(2)  +  u,(2))  ) 

15 18037735  +  0.8043403834u,  (0)  +  0.7504843666u,  (1)  +  0589108162u,  (2) 

(4-48) 

By  substituting  ( 4-42)  into  ( 4-48)  and  then  solving  the  resulting  set  of  simultaneous  linear 

equations,  it  can  be  shown  that  the  following  set  of  control  inputs 

uo(l)  =  u0(l),  u,(l)=  u,(l),  u0(2)=  u0(2), 

uo(0)  =  -2.886931 16  -  0.8252494404u0(l)-0.4140558684u0  (2), 

u,(0)  =  -14.97818061  +  0.4394459752u0(l)+ 0.09277687566u0(2)-  0.2770 198232u,  (l),  ’ 

u,(2)=  17.87365798 -05999987219u0(l)- 0.126673 152u0(2)- 0.8957033 186u,(l) 


x0(3) 

x,(3) 

x2(3) 


(4-49) 

will  produce  the  desired  state  ( 4-42).  Since  the  set  of  simultaneous  linear  equations  contains 
three  equations  and  six  unknowns,  the  solution  set  ( 4-49)  is  not  unique.  The  control  system 
designer  can  assign  any  value  to  u0(l),  uj(l),  and  u0(2).  The  required  values  for  u0(0),  ui(0), 
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and  ui(2)  can  then  be  computed  by  substituting  the  selected  values  of  uo(l),  ui(l),  and  uo(2) 
into  ( 4-49)  and  solving  the  resulting  set  of  equations.  For  example,  if  the  following  set  of 
inputs  is  assigned, 

{u0  (l)  =  2-5,  u  0  (2)  =  0,  u ,  (l)  =  25}, 


then  it  can  be  shown  that  inputs  of 

{u,  (2)  =  14.134,  u,  (0)  =  -14572,  u0  (0)  =  -^t.950} 


(4-50) 


(4-51) 

will  produce  the  desired  state  ( 4-42).  Hence,  by  definition  2.5  the  given  discrete  system  is 
completely  state  controllable. 


4.5.  Conclusion 

Until  now,  the  concept  of  controllability  had  not  been  applied  to  linear  time-varying 
multivariable  discrete  systems.  The  results  of  the  original  research  on  the  controllability  of 
this  class  of  systems  are  presented  in  this  chapter.  A  new  controllability  theorem  is 
developed  and  its  associated  controllability  matrix  is  derived  in  section  4.3.  A  proof 
demonstrating  the  full  rank  condition  of  the  controllability  matrix  as  a  necessary  and 
sufficient  condition  for  the  system  to  be  completely  state  controllable  is  provided.  The 
validity  of  the  controllability  matrix  and  theorem  is  demonstrated  in  section  4.4  through  the 
use  of  several  examples.  These  examples  successfully  demonstrate  that  the  state  variables  of 
a  linear  time-varying  discrete  system  which  is  completely  state  controllable  can  be  transferred 
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to  any  desired  state  in  a  finite  number  of  sampling  periods.  The  controllability  theorem  and 
matrix  developed  in  this  chapter  represent  advances  in  the  theory  of  linear  system  control. 
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CHAPTER  5 

STABILIZATION  OF  LINEAR  TIME- VARYING  DISCRETE  SYSTEMS 


5.1.  Introduction 

State  feedback  techniques  and  controllability  concepts  play  important  roles  in  the 
stabilization  and  optimization  of  linear  systems.  If  the  state  equation  of  a  linear  system  is 
controllable,  then  all  its  eigenvalues  can  be  arbitrarily  assigned  through  the  use  of  state 
feedback  [  6].  This  flexibility  in  eigenvalue  assignment  allows  the  control  system  designer  to 
stabilize  the  system  by  changing  unstable  eigenvalues  (those  with  non-negative  real  parts) 
into  stable  eigenvalues  (those  with  negative  real  parts). 

Extensive  research  has  been  conducted  in  the  area  of  state  feedback  for  certain  classes 
of  linear  continuous  systems  [  3]-[  5],  [17],  [27].  Nguyen  developed  a  state  feedback 
technique  to  transform  linear  time-varying  continuous  systems  which  satisfy  the  property  of 
lexicografixed  controllability  into  equivalent  time-invariant  systems  for  which  the 
eigenvalues  can  be  arbitrarily  assigned  [21].  State  feedback  techniques  have  also  been 
developed  for  linear  time-invariant  discrete  systems  which  satisfy  the  property  of  complete 
state  controllability  [25].  However,  in  the  case  of  linear  time- varying  discrete  systems,  state 
feedback  techniques  have  not  been  developed.  Now  that  the  concept  of  controllability  has 
been  extended  to  this  class  of  systems,  state  feedback  techniques  can  also  be  developed.  This 
chapter  focuses  on  the  development  of  state  feedback  techniques  for  a  class  of  linear  time- 
varying  discrete  systems. 
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5.2.  Problem  Statement 


In  order  to  stabilize  a  linear  time-varying  discrete  system,  state  feedback  techniques 
must  be  developed.  The  following  statement  defines  the  specific  problem  to  be  solved  in  this 
chapter. 

Given  a  linear  time-varying  discrete  system  which  satisfies  the  property  of  complete 
state  controllability,  develop  a  state  feedback  technique  for  which  the  closed-loop 
feedback  system  is  equivalent  to  an  asymptotically  stable  time-invariant  system  for 
which  the  eigenvalues  can  be  arbitrarily  assigned. 

The  scope  of  the  problem  addressed  is  reduced  by  considering  only  the  class  of  linear 
time-varying  single-input-single-output  discrete  systems  which  have  two  state  variables.  The 
approach  taken  to  solve  this  problem  is  similar  to  that  taken  in  [21]  for  linear  time- varying 
continuous  systems.  First,  in  section  5.3,  a  canonical  transformation  is  derived  which 
transforms  the  state  equation  of  the  given  system  into  an  equivalent  canonical  state  equation. 
Then,  in  section  5.4,  a  state  feedback  method  is  developed  which  transforms  the  canonical 
state  equation  into  an  equivalent  time-invariant  state  equation  for  which  the  eigenvalues  can 
be  arbitrarily  assigned.  Eigenvalues  which  asymptotically  stabilize  the  system  are  then 
assigned.  These  results  are  illustrated  through  the  use  of  an  example  in  section  5.5. 

5.3.  Canonical  Transformation  for  a  Class  of  Linear  Time-Varying  Discrete  Systems 

Three  steps  are  necessary  in  the  development  of  a  canonical  transformation  for  the 
class  of  linear  time-varying  single-input-single-output  discrete  systems  which  have  two  state 
variables: 
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1)  The  concept  of  an  equivalence  transformation  for  this  class  of  systems  must  be 
defined. 

2)  Equations  describing  the  equivalent  state  and  input  matrices  must  be  derived. 

3)  An  equivalence  transformation  converting  the  given  system  into  the  desired  canonical 
form  must  be  derived. 


5.3.1.  Definition  of  Equivalence  Transformation 

Consider  a  linear  time- varying  single-input-single-output  discrete  system  which  has 
two  state  variables.  Such  a  system  can  be  modeled  using  the  following  state  equation, 


If  there  exists  a  nonsingular  matrix  Q(k)  such  that 

x(k)  =  Q(k)x(k), 


(5-1) 


(5-2) 


(5-3) 


(5-4) 
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then  the  system  described  by 


x(k  + 1)  =  F(k)x(k)  +  G(k)u(k) 


(5-5) 


is  said  to  be  equivalent  to  the  original  system  (5-1)  and  the  matrix  Q(k)  is  said  to  be  an 
equivalence  transformation. 


5.3.2.  Derivation  of  the  Equivalent  State  and  Input  Matrices 

The  derivation  begins  by  calculating  the  equivalent  state  vector  ( 5-4)  at  the  k+lth 


sampling  instant: 


x(k  +  l)  =  Q(k  +  l)x(k  +  l). 


(5-6) 


Substituting  the  discrete  state  equation  (5-1)  into  ( 5-6)  yields 

x(k  + 1)  =  Q(k  +  l)[F(k)x(k)  +  G(k)u(k)] 

=  Q(k  +  l)F(k)x(k)  +  Q(k  +  l)G(k)u(k). 


(5-7) 


Solving  the  equivalent  state  vector  ( 5-4)  for  x(k)  and  substituting  the  result  into  ( 5-7)  yields 


x(k  + 1)  =  Q(k  +  l)F(k)Q-1  (k)x(k)  +  Q(k  +  l)G(k)u(k). 


The  equivalent  state  equation  ( 5-5)  can  be  obtained  by  substituting 


(5-8) 


F(k)  =  Q(k  +  l)F(k)Q-'(k) 


(5-9) 
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G(k)  =  Q(k  +  l)G(k) 


(5-10) 

into  (  5-8).  Equations  ( 5-9)  and  (  5-10)  define  the  equivalent  state  and  input  matrices. 

5.3.3.  Derivation  of  the  Equivalence  Transformation 

In  order  to  derive  an  equivalence  transformation,  it  is  necessary  to  first  identify  the 
desired  canonical  form.  For  this  derivation,  the  discrete  equivalent  of  the  canonical  form 
obtained  by  the  application  of  Nguyen’s  second  canonical  transformation  (2-32)  is  selected  as 
the  desired  canonical  form.  This  equivalence  transformation  converts  the  given  discrete 
system  (5-1)  into  an  equivalent  system  in  which  the  state  and  input  matrices  have  the 
following  canonical  form, 

Rki  =  *?00^  foi00 

[  1  0 


Using  (4-10),  the  controllability  matrix  of  (  5-1)  is  computed  as 

S  =  [G(n-l)  F(n  -  l)G(n  -  2)]. 


Substituting  k=n  into  (5-13)  yields, 


(5-11) 


(5-12) 


(5-13) 
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_  rg0(k-l)  foo(k-l)g0(k-2)  +  f01(k-  l)g , (k - 2) 

'  Lg.(k-l)  fj0  (k  -  l)g0  (k  -  2)  +  fu  (k  -  l)g ,  (k  —  2)_ 

_  Soo(k)  S01(k)' 

.SI0(k)  Sn  (k)_ 

(5-14) 

The  inverse  of  ( 5-14)  is  calculated  as 

3-,(k)==  _  i_  r^,(k)  -s01(k)' 

S00(k)SI1(k)  -  S10(k)S01(k)  1_-S10(k)  S^Ck).' 


(5-17) 

The  inverse  of  (5-17)  is  computed  as 

' _ QnOO _ -Qoi  (k) 

0-.^_  Qoo (k)Qn (k)  -  Qoi (k)Q10 (k)  Q00(k)Q11(k)-Q01(k)Q10(k) 

^  W"  -Qio(k) _ Qflo(k)  • 

-Qoo(k)Qi ,  (k)  -  Q01  (k)Q10(k)  Q00(k)QII  (k)  -  Q01  (k)Q10(k). 


Substituting  (  5-9)  into  ( 5-11)  and  (  5-10)  into  (  5-12)  yields 


(5-18) 
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—  .  fm(k)  fn.  (k) 

F(k)  =  Q(k+l)F(k)Q",(k)=  00  V  ^ 


(5-19) 


G(k)  =  Q(k  +  l)G(k)  = 


(5-20) 


The  two  elements  in  the  bottom  row  of  (5-19)  and  the  two  elements  of  (  5-20)  represent  the 

following  set  of  four  simultaneous  linear  equations, 

Q„  (k)QI0(k  +  l)foo(k)  +  Q„  (k)Q„(k  +  l)f,0(k) 

-Q10(k)Q10(k+  l)f01(k)  -  Qin(k)Qn(k  +  l)f„(k)  _ 

Q00(k)QI1(k)  — Q0,(k)Q10(k) 


Q01(k)Q10(k+  l)f00(k)  +  Q0I(k)Q„(k+  l)f10(k) 

-Qoo(k)Q10(k  +  l)f01(k)  -  Qoo(k)Q„(k  +  l)f„(k) 

Q00(k)Q1,(k)  -  Q01(k)Q10(k) 


(5-21) 


Qoo(k)g0(k  - 1)  +  Q0,(k)g,(k  - 1)  =  1, 


QI0(k)g0(k  - 1)  +  Qu(k)g,(k  -  1)  =  0. 


(5-22) 


(5-23) 


Solving  (5-21)  and  ( 5-22)  for  Q00(k)  and  Q0,(k)  yields 


(5-24) 


65 


Qoo(k)  =f00(k)QIO(k  +  1)  +f  I0(k)Qu(k  +  1) 


(5-25) 


Qoi(k)  =f0,(k)QIO(k  +  1)  +f  n(k)Qn(k  +  1). 


(5-26) 


Substituting  ( 5-25)  and  ( 5-26)  into  ( 5-23)  and  then  solving  ( 5-23)  and  ( 5-24)  for  Q10(k) 
and  Qn(k)  yields 

q  (jr-\  = _ ~&i  ^  ~  ^ _ _ 

~  rf,0(k-l)g0(k-2)  1  ~T foo(k  -  l)g0(k  -  2) 


g»(k-1l+f„0c-.)s,<k-2,J-^k-1U,(k- 


l)gi  (k  —  2) 


_  -S,n(k) 

S00(k)Sn(k)  -  S10(k)S01(k) 

=  Po(k) 


(5-27) 


Qn(k) 


|  = _ gp(k-l) _ 

^io(k  — l)go(k  — 2)  footk  —  l)g0(k  —  2) 

g”(k  V„  (k  -  l)g,  (k  -  2)J"  gl  <k  -  'l+fo.fk  -  l)g,  (k  -  2) 

_  _  _  SqoW 

Soo  (k)S„  (k)  -  S,0(k)S01  (k) 

=  P,(k). 


( 5-28) 


By  combining  the  results  of  ( 5-25)-(  5-28),  the  equivalence  transformation  Q(k)  is  defined  as 

p(k  +  l)F(k)l 

Q<  >=l  P(k)  } 


(5-29) 
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This  derivation  results  in  a  new  equivalence  transformation  (  5-29)  which  is  dependent  on  the 
discrete  controllability  matrix  (4-10).  Since  the  equivalent  state  matrix  ( 5-19)  is  a  function 
of  the  inverse  of  the  controllability  matrix,  complete  state  controllability  is  a  necessary 
condition  for  the  equivalence  transformation  Q(k)  to  exist. 

5.4.  State  Feedback  Techniques  for  a  Class  of  Linear  Time-Varying  Discrete  Systems 

Now  that  an  equivalence  transformation  has  been  derived  for  linear  time- varying 
discrete  systems,  it  is  possible  to  develop  a  state  feedback  theorem  for  this  class  of  systems. 

A  new  state  feedback  theorem  for  this  class  of  systems  is  now  introduced  and  subsequently 
proven. 

Theorem  5.1 

Consider  a  linear  time-varying  single-input-single-output  discrete  system  which  has 
two  state  variables.  If  the  state  equation  ( 5-1)  of  the  given  system  is  completely 
state  controllable,  then  there  exists  a  state  feedback  law  u(k)-K(k)x(k)  such  that  the 
closed-loop  feedback  system  is  equivalent  to  an  asymptotically  stable  time -invariant 
system  whose  state  matrix  assumes  the  form  of  (  5-30)  with  any  desired  eigenvalues. 

-a i  -a0‘ 

1  O  ' 

( 5-30) 

A  simple  proof  of  Theorem  5.1  is  presented.  In  the  previous  section  it  was  shown 
that,  if  the  state  equation  ( 5-1)  of  a  linear  time- varying  single-input-single-output  discrete 
system  which  has  two  state  variables  is  completely  state  controllable,  then  there  exists  a 
canonical  transformation  ( 5-29)  which  converts  (5-1)  into  an  equivalent  state  equation  with 
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state  and  input  matrices  given  by  (  5-1 1)  and  (  5-12).  If  the  desired  eigenvalues  of  the  closed 
loop  feedback  equivalent  system  are  represented  as  A,,  and  A2,  then  the  following  expression 
can  be  formed: 

(A- A^A- A2)  =  A2  +a,A+a0. 


If  the  equivalent  feedback  matrix  is  chosen  as 

K(k)  =  [-fTO(k)-oc,  -f„,(k)-a0], 


(5-31) 


( 5-33) 

The  eigenvalues  of  ( 5-33)  are  the  desired  eigenvalues  and  the  solution  to  ( 5-31).  The  proof 
is  complete. 

To  obtain  the  state  feedback  gain  matrix,  it  is  necessary  to  multiply  the  equivalent 
feedback  matrix  (  5-32)  by  the  equivalence  transformation  ( 5-29).  That  is, 

K(k)  =  K(k)Q(k). 


(5-34) 
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If  the  matrix  K(k)  is  chosen  correctly,  the  closed-loop  system  represented  in 


Figure  5-1  is  asymptotically  stable. 


Figure  5-1  Asymptotically  Stabilized,  Closed-Loop  System 
An  algorithm  for  determining  the  required  feedback  matrix  K(k)  is  given  below. 
Algorithm  5.1 

1)  Compute  the  equivalence  transformation  Q(k). 

2)  Compute  the  equivalent  state  and  input  matrices. 

3)  Select  desired  poles  and  compute  the  feedback  matrix  K(k)  required  to  give  the 
desired  poles. 

5.5.  Example 

The  following  example  is  used  to  illustrate  the  validity  of  Theorem  5.1  and  to 
demonstrate  the  use  of  Algorithm  5. 1  to  asymptotically  stabilize  a  linear  time- varying 
discrete  system. 

Consider  a  linear  time- varying  single-input-single-output  discrete  system  with  state 
equation  given  by  (3-22).  Since  it  was  shown  in  example  4-1  that  this  system  is  completely 
state  controllable,  then  by  Theorem  5.1  there  exists  a  state  feedback  law  to  asymptotically 
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stabilize  the  system.  Algorithm  5.1  is  now  employed  to  determine  the  required  feedback  gain 
matrix  K(k). 

a)  Compute  the  equivalence  transformation  Q(k).  Using  ( 5-14),  the  following 
matrix  is  formed, 

7 0.4881231 108  exp(-L5k7  ( 2.494549750exp(-1.5k)Y 

S(k)=  [+0.39334693403  J  [+0.2386512185  J  • 

1.359 14091 5 exp(-0.5k)  1.359140915exp(-0.5k) 


The  inverse  of  (5-35)  is  computed  as 


-1.359140914  2.494549750exp(-k)+  0.23865 12 1 85exp(05k)  ' 

1.359140914  -0.4881231 108exp(-k)-0.3934693403exp(05k) 

2.72701 6538  exp(-1.5k)- 0.2 104 196433 


( 5-35) 


( 5-36) 

The  matrix  p(k)  is  defined  in  (5-16)  as  the  bottom  row  of  the  inverse  of  S(k) .  Computing 
P(k)  yields 

_  [1.359 1409 14  -0.488 1231108  exp(-k)  -  0,3934693403  exp(05k)] 
2.727016538exp(-l^k)- 0.2104196433 


(5-37) 


The  equivalence  transformation  Q(k)  is  computed  from  ( 5-29)  as 


0.7381231 109exp(-1.5k) 


-0.25525193 


Q(k)  = 


1.359140914 

2.727016538exp(-1.5k) 

-0.2104196433 


0.1 51 632665  exp(-k)~  0.3934693403 
0.60847 963 69  exp(-  15k)  - 0.2 104196433 

r -0.488 1231108  exp(-k)  > 
^-0.3934693403  exp(0.5k); 
2.727016538exp(-15k)- 0.2104196433 


( 5-38) 

b)  Compute  the  equivalent  state  and  input  matrices.  From  (  5-9),  the  equivalent  state 


matrix  is  computed  as 


prk  rfoo(k)  f«(k)" 

[  1  0  J’ 


(5-39) 


where 


7  _  1-023932728 exp(-2ik)  -  1.039734596exp(-k) + 0.237 104788 1  exp(05k) 

—  1  1  . .  "  1 "  . 

0.2753779232  exp(-25k)  -  0.52201 5922 13exp(-k)+  0.1475880879  exp(Oik) 


(5-40) 


fm(k) 


-0.7485548044  exp(-2.5k) + 1.2 1 7886384 exp(-k)  -  0.0895 1 670022  exp(0  3k) 
0.2753779232exp(-23k)-032201592213exp(-k)+0.1475880879exp(03k) 


(5-41) 


From  ( 5-10),  the  equivalent  input  matrix  is  computed  as 

G(k)=^. 


(5-42) 
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c)  Calculate  the  feedback  matrix  K(k)  required  to  give  desired  poles  at 


=  05±0.5i. 


The  characteristic  equation  of  the  desired  system  is  computed  from  (5-31)  as 


(x  —  )(A,  —  %2 ) —  +  0C]A,+cx0, 


where 


a0  =  05 


a,  =  -1. 


The  equivalent  feedback  matrix  is  computed  from  ( 5-32)  as 


K(k)  =  [-f00(k)  +  l  -f0I (k) - 0.5]  =  [k0 (k)  k,(k)]. 


where 


(5-43) 


(5-44) 


(5-45) 


(5-46) 


(5-47) 


^  _  -7.485548048 exp(-2.5k)  +  5.1 77 1 86739  exp(-k)  -  0.895 1 670020 exp(03k) 

0  2.753779232exp(-25k)  -  5.22015922 1 3exp(-k)  + 1475880879  exp(05k) 


(5-48) 
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k,(k)  = 


6.10865843  exp(-25k)  -  9.56878423  exp(-k)+  0.1572265627  exp(0ik) 
2.753779232  exp(-25k)  -  5.220 1 5922 1 3  exp(-k)  + 1.475880879  exp(0ik) ' 


(5-49) 


The  closed  loop  feedback  equivalent  system  is  computed  from  ( 5-33)  as 

_  _  _  _  1  -Oil  f-a.  -an 

Fc  =  F(k)  +  G(k)K(k)=^  Q  j  Q  • 


( 5-50) 


Equation  ( 5-50)  shows  that  the  time-invariant  equivalent  matrix  has  the  desired  eigenvalues 
( 5-43)  and  is  therefore  asymptotically  stable.  The  feedback  matrix  K(k)  is  calculated  from 


( 5-34)  as 


K(k)  =  [k0(k)  k,(k)], 


(5-51) 


where 


k„(k)  = 


{\  17.7593053exp(-4k)  -  32.765 13858exp(-2ik)> 

^+0.438 1 5282  exp(-k)  - 1.10311 9477  exp(0.5k)  , 

-45.69439598  exp(-5ik)  + 105.9473859  exp(-4k) 

-62.34696063 exp(-2ik)  + 1 2.669827685  exp(-k)  -  0.6534673094  exp(Oik) 


(5-52) 


k,(k)  = 


^ -49.09660744 exp(-5k)  + 124.1 855694  exp(-3ik)  > 

^-49.43022 1 68 exp(-2k)  +  6.039829596  exp(-Oik)  -  0.6 109680328  exp(k); 
45.69439598 exp( -5.5k)  - 105.94738589  exp(-4k)  +  62.34696063  exp(-2ik) 
- 1 2.669827 685 exp(-k)  +  0.6534673094  exp(Oik) 


( 5-53) 
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5.6.  Conclusion 


Until  now,  equivalence  transformation,  state  feedback,  and  stabilization  techniques 
had  not  been  developed  for  linear  time-varying  single-input-single-output  discrete  systems. 
The  results  of  the  original  research  in  these  areas  for  this  class  of  systems  in  which  there  are 
two  state  variables  are  presented  in  this  chapter.  A  new  equivalence  transformation  which 
converts  such  a  system  into  an  equivalent  canonical  system  is  derived  in  section  5.3.  A  new 
state  feedback  theorem  for  this  class  of  systems  is  developed  and  proven  in  section  5.4.  A 
new  stabilization  algorithm  which  determines  the  required  feedback  gain  matrix  to 
asymptotically  stabilize  such  a  system  is  also  presented  in  section  5.4.  The  use  of  the 
equivalence  transformation,  state  feedback  theorem,  and  stabilization  algorithm  is 
demonstrated  in  section  5.5  through  the  use  of  an  example.  The  example  successfully 
demonstrates  that  a  linear  time- varying  discrete  system  which  is  completely  state  controllable 
can  be  asymptotically  stabilized  through  the  use  of  state  feedback. 
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CHAPTER  6 
CONCLUSION 


6.1.  Summary 

This  report  presents  the  development  of  a  new  control  scheme  for  linear  time-varying 
continuous  systems  which  do  not  satisfy  the  property  of  lexicografixed  controllability.  The 
scheme  involves  the  application  of  sample  and  hold  techniques  for  discretizing,  and 
canonical  transformation  and  state  feedback  techniques  for  stabilizing  the  given  continuous 
system.  Through  the  application  of  these  methods,  a  linear  time-varying  system  that  is  not 
lexicografixedly  controllable  in  continuous  time  can  be  controlled  and  stabilized  in  discrete 
time.  Until  now,  the  concepts  of  controllability  and  stability  and  the  techniques  of 
discretization,  canonical  transformation  and  state  feedback  had  not  been  exploited  for  the 
class  of  linear  time- varying  discrete  systems. 

Chapter  3  is  devoted  to  the  derivation  of  equations  modeling  the  discretization  of  a 
linear  time-varying  continuous  system.  The  equations  derived  model  the  resulting  discretized 
state  equations  in  terms  of  the  associated  continuous  state  equations.  The  results  indicate  that 
the  discretized  system  can  be  modeled  as  long  as  the  state  transition  matrix  of  the  continuous 
system  can  be  computed. 

In  Chapter  4,  the  concept  of  controllability  is  investigated  for  the  class  of  linear  time- 
varying  multivariable  discrete  systems.  Using  the  definition  of  controllability,  a 
controllability  matrix  is  derived  and  the  controllability  theorem  developed.  It  is  proved  that 
the  full  rank  condition  of  the  controllability  matrix  is  a  necessary  and  sufficient  condition  for 
the  system  to  be  completely  state  controllable.  The  results  show  that  the  controllability 


75 


matrix  of  a  time-varying  discrete  system  is  actually  time-invariant.  This  implies  that  in 
discrete  time  the  concepts  of  complete  state  controllability,  uniform  controllability,  and 
lexicograflxed  controllability  are  equivalent. 

The  concept  of  stability  for  linear  time-varying  discrete  systems  is  investigated  in 
Chapter  5.  The  derivation  of  a  canonical  transformation  for  linear  time- varying  single-input- 
single-output  discrete  systems  is  presented.  The  results  show  that  complete  state 
controllability  is  a  necessary  condition  for  the  canonical  transformation  to  exist.  A  state 
feedback  technique  and  its  associated  theorem  for  this  class  of  systems  are  also  developed. 
The  results  show  that  state  feedback  can  be  used  to  asymptotically  stabilize  this  class  of 
systems  as  long  as  the  given  system  is  completely  state  controllable.  An  algorithm  for 
determining  the  feedback  matrix  required  to  obtain  the  desired  poles  is  presented. 

The  results  of  this  research  show  that  a  limited  class  of  linear  time-varying  continuous 
systems  which  are  not  lexicografixedly  controllable  can  be  controlled  through  the  use  of  the 
proposed  control  scheme.  Based  on  the  results  of  Chapters  3-5,  this  class  of  systems  can  be 
identified  as  linear  time-varying  single-input-single-output  continuous  systems  which  have 
two  state  variables  and  a  known  state  transition  matrix  and  which  satisfy  the  property  of 
complete  state  controllability  in  discrete  time. 

Although  the  problem  statement  delineated  in  Chapter  1  focuses  on  linear  time- 
varying  multivariable  continuous  systems  which  are  not  lexicografixedly  controllable,  the 
results  of  this  research  are  valid  for  other  classes  of  systems  as  well.  The  discretization 
equations  in  Chapter  3  are  valid  for  all  continuous  systems  with  a  known  state  transition 
matrix.  The  controllability  matrix  and  theorem  presented  in  Chapter  4  are  valid  for  all 
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discrete  systems.  The  canonical  transformation  and  state  feedback  techniques  presented  in 
Chapter  5  are  valid  for  any  linear  time-varying  single-input-single-output  discrete  system 
which  has  two  state  variables. 

6.2.  Recommendations  for  Future  Research 

This  research  effort  solves  the  problems  of  controllability  and  stabilization  for  a 
limited  class  of  linear  discrete  systems.  Extensions  to  this  work  can  be  made  in  several 
directions.  Some  possibilities  for  future  research  are  listed  below: 

1)  Using  the  discretization  results  of  Chapter  3  and  the  controllability  results  of 
Chapter  4,  determine  the  subclass  of  linear  time-varying  continuous  systems 
which  are  not  lexicografixedly  controllable  that  can  be  made  completely  state 
controllable  through  discretization. 

2)  Investigate  the  use  of  a  variable  sampling  period  on  the  complete  state 
controllability  of  discretized  systems. 

3)  Using  the  duality  characteristic  between  controllability  and  observability,  derive 
an  observability  matrix  and  develop  the  associated  observability  theorem  for 
linear  time-varying  multivariable  discrete  systems. 

4)  Extend  the  use  of  the  canonical  transformation  derived  in  Chapter  5  to  cover  the 
entire  class  of  linear  time- varying  multivariable  discrete  systems  which  are 
completely  state  controllable.  Develop  other  canonical  transformations  for  this 
class  of  systems.  Using  the  duality  characteristic  between  controllability  and 
observability,  derive  canonical  transformations  for  linear  time-varying 
multivariable  discrete  systems  which  are  completely  state  observable. 
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5)  Extend  the  state  feedback  technique  developed  in  Chapter  5  to  cover  the  entire 
class  of  linear  time-varying  multivariable  discrete  systems  which  are  completely 
state  controllable.  Using  the  duality  characteristic  between  controllability  and 
observability,  develop  an  asymptotic  state  estimator  technique  for  linear  time- 
varying  multivariable  discrete  systems  which  are  completely  state  observable. 
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APPENDIX  A 

ILIR  SOFTWARE  ALGORITHMS 


This  Appendix  contains  the  symbolic  math  routines  written  in  support  of  this  research 
effort.  The  control  algorithms  developed  in  Chapters  3-5  were  coded  in  the  Maple  symbolic 
math  language  and  stored  in  a  library  package  which  is  included  in  Section  A.  1 .  The  Maple 
code  written  to  solve  the  example  problems  in  Chapters  3-5  is  included  in  Section  A.2.  The 
example  problems  are  solved  by  invoking  the  procedures  stored  in  the  ILIR  library  package. 
A.l.  Maple  Library  Routines 

#  ILIR  package. 

#  Programmed  by  Mark  G.  Matthews 

#  CECOM  RD&E  Center, 

#  Power  Generation  Branch 

#  AMSEL-RD-C2-PP-P,  Fort  Belvoir,  VA.  22060 

#  This  package  consists  of  the  Maple  code  written  in  support  of  the  FY94  In-House 

#  Laboratory  Independent  Research  (ILIR)  Topic, 

#  "State  Controllability  Techniques  For  Linear  Time-Varying  Discrete  Systems." 
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#  The  following  routine  is  used  in  Chapter  3  to  compute  the  controllability  matrix  of  a 

#  linear  time-varying  continuous  system. 

# 

ilir  [ContControlMatrix]  :=proc('  A(t)' B(t)' )  ^ 

local 'Ml(t)', 'M2(t)','M3(t)':  #  local  variable  declarations 
global  'M(t)':  #  global  variable  declarations 
if 

coldim('A(t)')>3  #  the  algorithm  was  only  written  for  2x2  and  3x3  state  matrices 
then 

print('this  algorithm  will  not  work  for  systems  with  a  state  matrix  bigger  than  3x3'); 

RETURN 

fi: 

'Ml  (t)'  :=evalm('B(t)'): 

'M2(t)':=evalm(-'A(t)'&*'Ml(t)'+map(diff,'Ml(t)',t)): 
if  coldim('A(t)')=2 

then  'M(t)'  :=augment('Ml (t)' ,'M2(t)');  #  eq  (2-18)  for  a  2x2  state  matrix 

RETURN 

else 

'M3(t)':=evalm(-'A(t)'&*'M2(t)'+map(diff,'M2(t)',t)): 
'M(t)':=augment('Ml(t)','M2(t)',  'M3(t)');  #  eq  (2-18)  for  a  3x3  state  matrix 
ft: 

end: 
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#  The  following  routine  is  used  in  Chapter  3  to  discretize  a  linear  time-varying  continuous 

#  system. 

# 

ilirfdiscretize]  :=proc('A(t)'  ,'B(t)'  ,'C(t)'  ,'D(t)') 

global  'F(k,T)\  'G(k,T)\  'C(k,T)\  'D(k,T)',  'int_A(tau)\  'Phi(t,tO)\  'A(tau)': 

'  A(tau)'  :=subs(t=tau,evalm('  A(t)')); 

'  int_A(tau)' : =map(int,'  A(tau)'  ,tau=tO.  .t) ; 
if  #  check  for  commutative  property 

equal(evalm('A(t)'&*'int_A(tau)v),evalm('int_A(tau)'&*'A(t)'))=false 

then  #  algorithm  written  to  handle  commutative  systems  only 

printfthis  algorithm  will  not  work  for  systems  with  a  non-commutative  state  matrix'); 

RETURN; 

else 

'Phi(t,tO)'  :=exponential('int_A(tau)'):  #  eq  (2-9) 

'F(k,T)':=map(simplify,subs(t=(k+l)*T,tO=k*T,evalm('Phi(t,tO)'))):  #  eq  (3-9) 
'G(k,T)':=map(int,evalm(subs(t=(k+l)*T,tO=tau,evalm('Phi(t,tO)')) 

&*subs(t=tau,evalm('B(t)'))),tau=(k*T)..(k+l)*T):  #  eq  (3-10) 

'  G(k,T)'  :=map(simplify  ,evalm('  G(k,T)')): 

' C(k,T)' :  =subs(t=k*T,evalm(' C(t)' )) :  #  eq  (3-1 1) 

'D(k,T)v :=subs(t=k*T,evalm('D(t)')):  #  eq  (3-12) 
ft; 

end: 
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#  The  following  routine  is  used  in  Chapter  4  to  compute  the  controllability  matrix  of  a 

#  linear  time- varying  discrete  system. 

# 

ilir[DiscreteControlMatrix]  :=proc('F(k,T)'  ,'G(k,T)') 

global  'S(T)',Sdet: 

local  G2,  Gl,  GO,  F2,  FI,  S2,  S1,S0: 

if 

coldim('F(k,T)')>3  #  the  algorithm  was  only  written  for  2x2  and  3x3  state  matrices 
then 

print  (This  algorithm  will  not  work  for  systems  with  a  state  matrix  bigger  than  3x3'); 

RETURN 

ft: 

if 

coldim('F(k,T)>2 

then 

Gl  :=subs(k=l,evalm('G(k,T)')): 

G0:=subs(k=0,evalm('G(k,T)')): 

FI  :=subs(k=  1  ,evalm('F(k,T)' )): 

S 1 :  =evalm(F  1  &*  GO) : 

SO:=evalm(Gl): 

'S(T)':=map(simplify,augment(SO,Sl)):  #  eq  (4-10)  for  a  2x2  state  matrix 
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if 

coldim('S(T)')=2 

then 

Sdet:=simplify(det('S(T)'));  #  determinant  of  the  discrete  controllability  matrix 
ft: 

RETURN 

else 

G2  :=map(simplify  ,subs(k=2,evalm('  G(k,T)' ))) ; 

G 1  :=map(simplify  ,subs(k=  1  ,evalm('  G(k,T)'))); 
GO:=map(simplify,subs(k=0,evalm('G(k,T)v))); 
F2:=map(simplify,subs(k=2,evalm('F(k,T)'))); 

F 1  :=map(simplify  ,subs(k=  1  ,evalm('F(k,T)'»); 

S0:=evalm(G2); 

S 1  :=map(simplify,evalm(F2&*Gl)); 

S2:=map(simplify,evalm(F2&*Fl&*G0)); 

'  S  (T)'  :=augment(SO,S  1  ,S2);  #  eq  (4-10)  for  a  3x3  state  matrix 
ft: 

end: 
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#  The  following  routine  is  used  in  Chapter  4  to  compute  the  inputs  required  to  transfer  the 

#  controllable  system  from  a  given  state  to  a  desired  state  in  n  sampling  periods. 

# 

ilir[InputsRequired]:=proc(xO,xfinal,  period) 

global  'u(required)',  'x(k+l)\  'x(l)',  'x(2)\  'x(3)\  'F(k)',  'G(k)',  eql,  eq2,  eq3: 
if 

rowdim(xfinal)>3  #  the  algorithm  was  only  written  for  2x2  and  3x3  state  matrices 
then 

printfthis  algorithm  will  not  work  for  systems  with  a  state  matrix  bigger  than  3x3'); 

RETURN 

fi: 

'F(k)':=map(evalf,map(expand,subs(T=period,evalm('F(k,T)')))); 

#  the  state  matrix  at  a  fixed  sampling  period 

'  G(k)' :  =map(evalf ,map(expand,subs(T=period,evalm('  G(k,T)' )))) ; 

#  the  input  matrix  at  a  fixed  sampling  period 
if 

rowdim(xfinal)=2  #  algorithm  for  a  system  with  a  2x2  state  matrix 
then 

'x(k+l)':=evahn('F(k)')&*'x(k)'+evalm('G(k)')*'u(k)': 

#  the  state  equation  at  a  fixed  sampling  period 

'x(l)'  :=evalm(subs(k=0,'x(k)'=evalm(x0),'u(k)'=u0,'x(k+l)')): 

#  the  state  equation  at  the  first  sampling  instant 
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'x(2)':=evalm(subs(k=l,'x(k)'='x(l)\'u(k)'=ul,'x(k+l)')): 

#  the  state  equation  at  the  second  sampling  instant 
eql:='x(2)'[l,l]:  #  first  simultaneous  linear  equation 
eq2:='x(2)'[2,l]:  #  second  simultaneous  linear  equation 
'u(required)'  :=evalf(solve(  { eq  1  =xfinal  [  1 , 1  ],eq2=xfinal  [2, 1  ] } ,  { uO,u  1 } )) ; 

#  solving  two  simultaneous  linear  equation  with  two  unknowns  to  determine  the  input 

#  required  to  transfer  the  system  from  the  initial  state  to  the  desired  state 
RETURN 

fi: 

if 

rowdim(xfinal)=3  #  algorithm  for  a  system  with  a  3x3  state  matrix 
then 

'  x(k+l )'  :=evalm('F(k)v  )&*'x(k)v  +evalm('  G(k)'  )&*'u(k)' ; 

#  the  state  equation  at  a  fixed  sampling  period 

x(l)':=map(evalf,evalm(subs(k=0,'x(k)'=evalm(x0),'u(k)'=matrix(2,l,[u00,ul0]),'x(k+l)')) 

); 

#  the  state  equation  at  the  first  sampling  instant 

'x(2)':=map(evalf,evalm(subs(k=l,'x(k)'=evalmCx(l)'),'u(k)v=matrix(2,l,[u01,ull]), 

vx(k+l)'))); 

#  the  state  equation  at  the  second  sampling  instant 

'x(3)' :  =map(evalf,evalm(subs(k=2,'x(k)' =evalmf  x(2)' ) u(k)'=matrix(2, 1 ,  [u02,u  12]), 
'x(k+l)')»; 
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#  the  state  equation  at  the  third  sampling  instant 
eql:='x(3)'[l,l]=xfinal[l,l];  #  first  simultaneous  linear  equation 
eq2:='x(3)'[2,l]=xfinal[2,l];  #  second  simultaneous  linear  equation 
eq3:='x(3)'[3,l]=xfinal[3,l];  #  third  simultaneous  linear  equation 
'u(required)'  :=solve(  { eq  1  ,eq2,eq3 } ,  { u00,u0 1  ,u02,ul0,ul  1  ,u  12 } ): 

#  solving  three  simultaneous  linear  equations  with  six  unknowns  to  find  the  non-unique  input 

#  required  to  transfer  the  system  from  the  initial  state  to  the  final  desired  state 
RETURN 

fi: 

end: 
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#  The  following  example  is  used  in  Chapter  5  to  compute  the  feedback  gain  matrix 
required 

#  to  give  closed-loop  poles  at  desired  locations. 

# 

ilir  [StateFeedback]  :=proc(pole  1  ,pole2, period) 

global  'Q(k)\  'Fbar(k)\  'Gbar(k)',  'Fbar(k)c','K(k)\'F(k)';G(k)','Kbar(k)\'Sbar(k)', 
'Sbarinv(k)',  'Beta(k)\  char_eq,  alpha,  alphaO,  alphal,  alpha2: 
local  'SbarOO(k)',  'SbarOl(k)',  'SbarlO(k)',  'Sbarl  l(k)\  'Beta(k+l)F(k)': 
'F(k)':=map(evalf,map(expand,subs(T=period,evalm('F(k,T)')))); 
'G(k)':=map(evalf,map(expand,subs(T=period,evalm('G(k,T)')))); 

'SbarOO(k)'  :=evalf(expand(subs(k=k- 1  ,'G(k)'  [  1 , 1]))): 

'SbarlO(k)':=evalf(expand(subs(k=k- 1  ,'G(k)'  [2,1]))): 

'  SbarO  1  (k)'  :=evalf(expand(subs(k=k- 1  ,vF(k)'  [  1 , 1  ])*subs(k=k-2,'G(k)'  [1,1]) 

+subs(k=k- 1  ,'F(k)'  [  1 ,2])*subs(k=k-2,'G(k)'  [2,1]))): 

'  Sbar  1 1  (k)'  :=evalf(expand(subs(k=k- 1  ,'F(k)'  [2, 1  ])*subs(k=k-2,'  G(k)'  [1,1]) 
+subs(k=k-l,'F(k)'[2,2])*subs(k=k-2,'G(k)'[2,l]))): 

'  Sbar(k)'  :=matrix(2,2,  ['  SbarOO(k)' SbarO  1  (k)' ,'  Sbar  1 0(k)' ,'  Sbar  1 1  (k)'  ]) ; 
'Sbarinv(k)':=inverse(vSbar(k)'); 

'Beta(k)'  :=map(evalf,map(expand,matrix(  1 ,2,['Sbarinv(k)'  [2,1],  'Sbarinv(k)'  [2,2]]))): 
'Beta(k+l)F(k)':= 

map(evalf,map(expand,evalm(subs(k=k+ 1  ,evalm('  Beta(k)'  ))&*evalm('  F(k)' )))) : 
'Q(k)':=map(simplify,matrix(2,2,['Beta(k+l)F(k)'[l,l],'Beta(k+l)F(k)'[l,2],'Beta(k)'[l,l], 
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'Beta(k)'[l,2]])): 

'Fbar(k)'  :=map(simplify,map(expand,evalm(subs(k=k+ 1  ,evalm('  Q(k)' )) 
&*evalm('F(k)')&*inverse(evalm('Q(k)' ))))); 

'Fbar(k)'[2,l]:=l: 

'Fbar(k)'[2,2]:=0; 

'Gbar(k)v  :=matrix(2, 1  ,[1,0]); 

char_eq  :=expand((lambda-pole  1 )  *  (lambda-pole2)) ; 

alphaO:  =coeff(char_eq,  lambda,  0) : 

alpha  1:=  coeff(char_eq,lambda,l): 

alpha2:=  coeff(char_eq,lambda,2): 

alpha:=coeffs(normal(expand((lambda-polel)*(lambda-pole2)))); 

'  Kbar(k)'  :=map(simplify,matrix(  1 ,2,[-'Fbar(k)'  [1,1  ]-alphal,-'Fbar(k)'  [  1 ,2]-alpha0])) : 
'Fbar(k)c'  :=matrix(2,2 ,  [-alpha  1 , -alphaO,  1,0]): 
'K(k)':=map(simplify,evalm('Kbar(k)v&*'Q(k)')): 
end: 

# 

save  ilir;  #  save  the  ilir  library  package  to  a  file 
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A.2.  Maple  Code  for  Example  Problems 
A.2.1.  Example  3-1 

>#File=ilir3-l.ms 

>  #  This  file  contains  the  code  used  to  solve  example  3-1 

>  with(linalg):  #  make  the  linear  algebra  package  available 

> '  A(t)v  :=matrix(2,2,[- 1  ,exp(-2*t),0,- 1  ]):  #  the  given  state  matrix 
> 'B(t)':=matrix(2,l,[l,exp(l-t)]):  #  the  given  input  matrix 
> 'C(t)':=matrix(l,2,[exp(-2*t),-l]):  #  the  given  output  matrix 
>'D(t)':=l:  #  the  given  direct  transmission  matrix 

>  read  'ilir':  #  read  the  ilir  library  package 

>  ilir[ContControlMatrix]('A(t)YB(t)'):  #  compute  the  continuous  controllability  matrix 

>  evalm('M(t)');  #  eq(3-18) 

>  'M(t)':=map(combine,'M(t)',exp);  #  simplifying  eq  (3-18) 
>'Mdet(t)':=combine(expand(det('M(t)')),exp);  #eq(3-19) 

>  plot('Mdet(t)\t=0..5);  #  Figure  3-1 

>  fsolve('Mdet(t)'=0,t=0..0.5);  #  solving  for  the  zero  crossing  in  Figure  3-1 

>  ilir  [discretize]  ('A(t)YB(t)YC(t)YD(t)'):  #  discretize  the  given  system 

>  evalmf  int_A(tau)' & *'  A(t)' ) ;  #  eq  (3-20) 

>  print('Phi(t,tO)');  #  eq(3-21) 

>  print('F(k,T)');  #  eq  (3-22) 

>  print('G(k,T)');  #  eq  (3-23) 

>  print('C(k,T)');  #  eq  (3-24) 

>  print('D(k,T)');  #  eq  (3-25) 


92 


A.2.2.  Example  3-2 

>  #  File=ilir3-2.ms 

>  #  This  file  contains  the  code  used  to  solve  example  3- 1 

>  with(linalg):  #  make  the  linear  algebra  package  available 

> 'A(t)':=matrix(2,2,[exp(-t),0,0,exp(-t)]):  #  the  given  state  matrix 

>  'B(t)' :=matrix(2,2,[  1 , 1 , 1 , 1  ]):  #  the  given  input  matrix 
> 'C(t)':=matrix(l,2,[t,l]):  #  the  given  output  matrix 

> 'D(t)':=matrix(l,2,[t,l]):  #  the  given  direct  transmission  matrix 
>read'ilir':  #  read  the  ilir  library  package 

>  ilir[ContControlMatrix]('A(t)YB(t)'):  #  compute  the  continuous  controllability  matrix 

>  print('M(t)');  #  eq(3-31) 

>  ilir[discretize]('A(t)YB(t)\'C(t)YD(t)'):  #  discretize  the  given  system 

>  print('Phi(t,tO)');  #  eq  (3-32) 

>  print('F(k,T)v);  #  eq  (3-33) 

>  print('G(k,T)');  #  eq  (3-34) 

>  print('C(k,T)');  #  eq  (3-37) 

>  print('D(k,T)v);  #  eq(3-38) 
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A.2.3.  Example  3-3 

>  #  File=ilir3-3.ms 

>  #  This  file  contains  the  code  used  to  solve  example  3-3 

>  with(linalg):  #  make  the  linear  algebra  package  available 

>  vA(t)':=matrix(3,3,[2-4*exp(-2*t),0,0,0,l,0,0,0,3/2-2/(t+l)]);  #  the  given  state  matrix 

>  'B(t)'  :=matrix(3,2,[  1,0,1,1,0,13);  #  the  given  input  matrix 

>  read 'ilir':  #  read  the  ilir  library  package 

>  ilir[ContControlMatrix]('A(t)','B(t)'):  #  compute  the  continuous  controllability  matrix 

>  print('M(t)');  #  eq(3-44) 

>  ilir[discretize]('A(t)','B(t)','C(t)','D(t)'):  #  discretize  the  given  system 

>  print('Phi(t,tO)');  #  eq  (3-45) 

>  print('F(k,T)');  #  eq  (3-46) 

>  print('G(k,T)');  #  eq  (3-47) 
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A.2.4.  Example  4-1 
>#  File=ilir4-l.ms 

>  #  This  file  contains  the  code  used  to  solve  example  4-1 

>  with(linalg):  #  make  the  linear  algebra  package  available 

> '  A(t)'  :=matrix(2,2,  [- 1  ,exp(-2*t),0,- 1  ]):  #  the  given  state  matrix 
>'B(t)':=matrix(2,l,[l,exp(l-t)]):  #  the  given  input  matrix 

>  vC(t)':=matrix(l,2,[exp(-2*t),-l]):  #  the  given  output  matrix 

>  'D(t)':=l:  #  the  given  direct  transmission  matrix 

>  read  'ilir':  #  read  the  ilir  library  package 

>  ilir[discretize]('A(t)YB(t)YC(t)\'D(t)'):  #  discretize  the  given  system 
>ilir[DiscreteControlMatrix]('F(k,T)YG(k,T)'): 

#  calculate  the  discrete  controllability  matrix 

>  map(simplify,'S(T)');  #  eq(4-15) 

>  simplify(Sdet);  #  eq(4-16) 

>  plot(Sdet,T=0..3.5);  #  Figure  4-1 

>  zerol:=fsolve(Sdet=0,T=0..0.1);  #  first  zero  crossing 

>  zero2:=fsolve(Sdet=0,T=0.3..0.4);  #  second  zero  crossing 

>  lowl:=fsolve(Sdet=-0.001,T=0..0.2);  #  computing  desirable  range  of  T 

>  low2:=fsolve(Sdet=-0.001,T=0.2..0.4);  #  computing  desirable  range  of  T 

>  low3:=fsolve(Sdet=0.001,T=0.3..0.4);  #  computing  desirable  range  of  T 

>  low3:=fsolve(Sdet=0.001,T=4..5);  #  computing  desirable  range  of  T 

>  x0:=matrix(2,l,[2.0,5.0]);  #  given  initial  state 
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>  x2:=matrix(2,l,[0.5,2.5]);  #  desired  final  state 

>  period:=0.5;  #  selected  sampling  period 

>  ilir[InputsRequired](xO,x2,period): 

#  calculating  inputs  required  to  transfer  system  from  given  initial  state  to  final  desired  state 
>print('x(k+l)');  #  eq(4-20) 

>map(evalf,'x(l)');#  eq(4-21) 

>  map(evalf,'x(2)');  #  eq  (4-22) 

>  print 0 u(required)' ) ;  #  eq  (4-23) 
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A.2.5.  Example  4-2 
>#  File=ilir4-2.ms 

>  #  This  file  contains  the  code  used  to  solve  example  4-2 

>  with(linalg):  #  make  the  linear  algebra  package  available 

>  'A(t)':=matrix(2,2,[exp(-t),0,0,exp(-t)]):  #  the  given  state  matrix 
>'B(t)':=matrix(2,2,[l,l»l>l]):  #  the  given  input  matrix 

> 'C(t)':=matrix(l,2,[t,l]):  #  the  given  output  matrix 
> 'D(t)':=matrix(l,2,[t,l]):  #  the  given  direct  transmission  matrix 
>read'ilirs:  #  read  the  ilir  library  package 

>  ilir[discretize]('A(t)YB(t)YC(t)\'D(t)'):  #  discretize  the  given  system 

>  ilir[DiscreteControlMatrix]('F(k,T)','G(k,T)'):  #  calculate  discrete  controllability  matrix 

>  map(simplify,'S(T)');  #  eq(4-24) 
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A.2.6.  Example  4-3 
>#  File=ilir4-3.ms 

>  #  This  file  contains  the  code  used  to  solve  example  4-3 

>  with(linalg):  #  make  the  linear  algebra  package  available 

>  'A(t)':=matrix(3,3,[2-4*exp(-2*t),0,0,0,l,0,0,0,3/2-2/(t+l)]):  #  the  given  state  matrix 

>  'B(t)':=matrix(3, 2, [1,0,1, 1,0,1]):  #  the  given  input  matrix 
>read'ilir':  #  read  the  ilir  library  package 

>  ilir[discretize]('A(t)','B(t)',vC(t)','D(t)'):  #  discretize  the  given  system 

>  ilir[DiscreteControlMatrix]('F(k,T)','G(k,T)'):  #  calculate  discrete  controllability  matrix 

>  map(simplify ,'  S(T)' );  #  eq  (4-27) 

>  'Ssub(T)':=augment(col('S(T)',l),col('S(T)\2),col('S(T)',3));  #  eq  (4-38) 

> 'Sdet(T)v:=simplify(det('Ssub(T)'));  #  eq  (4-39) 

>  plot('Sdet(T)',T=0..0.5);  #  Figure  4-2 

>  first_zero:=fsolve('Sdet(T)'=0,T,0..0.1);  #  first  zero  crossing 

>  second_zero:=fsolve('Sdet(T)'=0,T,0.3..0.4);  #  second  zero  crossing 

>  negl :=fsolve('Sdet(T)' =-0.001, T,0..0.2);  #  computing  desirable  range  of  T 

>  neg2:=fsolve('Sdet(T)"  =-0.001, T,0.2..0.4);  #  computing  desirable  range  of  T 

>  pos2:=fsolve('Sdet(T)' =0.001, T,0.35..0.4);  #  computing  desirable  range  of  T 

>  high:=fsolve('Sdet(T)'=10A6,T,1.0..3.0);  #  computing  desirable  range  of  T 

>  x0:=matrix(3,l,[2.0,5.0,1.0]);  #  given  initial  state 

>  x3:=matrix(3,l,[0.5,2.5,0.]);  #  desired  final  state 

>  period:=0.5:  #  selected  sampling  period 
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>  ilir[InputsRequired]  (xO,x3 , period) : 

#  calculating  inputs  required  to  transfer  system  from  given  initial  state  to  final  desired  state 

>  printfF(k)');  #  eq  (4-44) 

>  print('G(k)v);  #  eq  (4-45) 

>print('x(l)');  #  eq  (4-46) 

>  print('x(2)');  #  eq  (4-47) 

>  print('x(3)');  #  eq  (4-48) 

>  print('u(required)');  #  eq  (4-49) 

>u01:=2.5;  #  assigned  input 
>u02:=0;  #  assigned  input 
>ull:=2.5;  #  assigned  input 

>  solve({eql,eq2,eq3},{uOO,ulO,ul2});  #  eq(4-51) 
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A.2.7.  Example  5-1 

#  File=ilir5-l.ms 

#  Maple  code  used  to  solve  example  5-1 

>  with(linalg):  #  make  the  linear  algebra  package  available 

>  vA(t)':=matrix(2,2,[-l,exp(-2*t),0,-l]);  #  the  given  state  matrix 

>  'B(t)':=matrix(2,l,[l,exp(l-t)]);  #  the  given  input  matrix 

>  'C(t)'  :=matrix(  1 ,2,[exp(-2*t),- 1  ]);  #  the  given  output  matrix 

>  'D(t)':=l;  #  the  given  direct  transmission  matrix 
>read'ilir':  #  read  the  ilir  library  routines 

>  ilir[discretize]('A(t)\'B(t)YC(t)\'D(t)'):  #  discretize  the  system 

>  ilir[DiscreteControlMatrix]('F(k,T)','G(k,T)'):  #  compute  discrete  controllability  matrix 

>  period:=0.5:  #  selected  sampling  period 

>  polel:=0.5+0.5*I:  #  desired  pole 

>  pole2:=0.5-0.5*I:  #  desired  pole 

>  ilir[StateFeedback](polel,pole2, period):  #  invoke  the  state  feedback  algorithm 

>  map(simplify,'Sbar(k)');  #  eq  (5-35) 

>  print('Sbarinv(k)');  #  eq  (5-36) 

>  printfBeta(k)');  #  eq  (5-37) 

>  print('Q(k)');  #  eq  (5-38) 

>  print('Fbar(k)');  #  eq  (5-39) 

>  print('Gbar(k)');  #  eq  (5-42) 

>  print(char_eq);  #eq(5-44) 
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>  print(alphaO,  alphal);  #  eqs  (5-45)-5-46) 

>  print('Kbar(k)');  #  eq  (5-47) 

>  print('Fbar(k)c');  #  eq  (5-50) 

>  printOK(k)');  #eq(5-51) 
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APPENDIX  B 
ISCA  PAPER 


The  principal  investigator  presented  an  invited  paper  documenting  interim  ILIR 
results  on  controllability  and  served  as  a  Session  Chair  at  the  1994  International  Conference 
on  Computers  and  Their  Applications  [15].  This  paper  is  included  in  this  Appendix. 
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A  New  Approach  To  Control  Of  Time- Varying  Robotic  Systems 


Mark  G.  Matthews 
Power  Generation  Division 
US  Army  Belvoir  RD&E  Center 
Fort  Belvoir,  VA  22060 

Abstract 

A  robot  manipulator  can  be  modeled  by  a  linear,  time- 
varying,  multivariable  system  which  is  obtained  by 
linearizing  the  manipulator  dynamics  about  a  moving 
operating  point  on  the  path  that  the  manipulator  tracks. 
It  is  found  that  if  a  time- varying  system  is 
lexicografixedly  controllable,  then  there  exists  a  state 
feedback  controller  which  can  assign  an  arbitrary  set  of 
eigenvalues  to  the  closed-loop,  feedback  system.  This 
paper  presents  some  preliminary  results  of  a  new 
approach  to  control  of  robotic  systems  modeled  by  a 
linear,  time- varying  system  that  is  not  lexicografixedly 
controllable.  The  proposed  approach  considers 
discretization  of  the  time- varying  system  and  selection 
of  a  sampling  time  to  make  the  resulting  discrete  system 
become  lexicografixedly  controllable.  After  defining 
the  controllability  of  time-varying,  discrete  systems,  a 
theorem  is  given  and  proved.  An  example  of  a  single- 
input-single-output  (SISO)  system  is  carried  out  to 
demonstrate  the  dependence  of  controllability  on 
sampling  times. 

1  Introduction 

The  inherent  nonlinearity  of  robotic  systems,  caused 
by  intercoupling  of  joints,  combined  with  the 
uncertainty  in  their  dynamics  make  the  control  of  such 
systems  a  challenging  task.  Consequently,  advanced 
control  schemes,  such  as  adaptive  control  schemes  [1], 
have  been  developed  for  controlling  robot  motion.  A 
simple  but  effective  method  for  robot  control  is  the  use 
of  linearization  about  a  selected  fixed  operating  point 
resulting  in  a  linear,  time-invariant  system  representing 
an  approximated  model  of  the  robot  system  [8].  The 
performance  of  the  above  scheme  starts  to  degrade  as 
the  robot  moves  away  from  the  operating  point.  To 
improve  the  performance  of  the  above  scheme,  a  so 
called  path-dependent  linearization  was  developed  [7]- 
[8]  so  that  the  linearized  model  can  be  updated  as  the 
robot  moves  along  the  desired  path.  Based  upon  the 
linearization  about  a  moving  operating  point  whose 
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position  and  orientation  are  functions  of  time,  this 
improved  method  results  in  a  linear,  time- varying 
system  which  can  accurately  model  the  robot  dynamics. 
The  study  in  [3]  found  that  if  a  time-varying  system  is 
lexicografixedly  controllable,  then  there  exists  a  state 
feedback  controller  [4]  which  can  assign  an  arbitrary  set 
of  eigenvalues  to  the  closed-loop  feedback  system. 

This  paper  considers  the  control  problem  of  a  robotic 
system  which  is  modeled  by  a  linear,  time-varying 
system  that  is  not  lexicografixedly  controllable.  A  new 
approach  to  be  proposed  will  consider  discretization  of 
the  time-varying  system  and  selection  of  a  sampling 
time  to  make  the  resulting  time- varying,  discrete  system 
become  lexicografixedly  controllable.  Developed 
algorithms  for  lexicografixedly  controllable  systems 
given  in  [4]  may  then  be  applied  to  control  the  time- 
varying,  discrete,  robotic  systems. 

This  paper  presents  some  preliminary  results  of  the 
study  and  is  organized  as  follows.  Section  2  presents 
the  discretization  using  zero-order  hold  (ZOH)  devices. 
Section  3  defines  the  controllability  of  the  resulting, 
time-varying,  discrete  system  and  introduces  a  theorem 
to  facilitate  the  testing  for  controllability.  The  concept 
of  controllability  is  then  investigated  for  a  single-input- 
single-output  (SISO)  system  and  the  results  are 
presented  in  Section  4.  Section  5  outlines  the  future 
research  and  concludes  the  paper. 

2  Discretization 

The  dynamics  of  a  robot  manipulator  having  n 
degrees  of  freedom  can  be  described  by  the  following 
equation  of  motion, 

T(t)  =  M(q)q'+N(q,q')  +  G(q), 

0) 

where  x(t)  is  the  (nxl)  joint  torque  vector,  and  q,  q'and 
q"  are  the  (nxl)  vectors  of  joint  positions,  velocities, 
and  accelerations,  respectively.  M(q),  N(q,q')  and  G(q) 
represent  the  (nxn)  inertia  matrix,  the  (nxl)  Coriolis 
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(centrifugal  and  frictional  force)  vectors,  and  the  (nxl) 
gravity  vector,  respectively. 

Linearizing  (1)  with  respect  to  an  operating  point 
whose  joint  position,  velocity,  and  acceleration  are 
evaluated  along  a  desired  path,  and  are  thus  functions  of 
time,  the  following  linear,  time- varying,  state  equations 
are  obtained: 

x(t)  =  A(t)x(t)  +  B(t)u(t) 
y(t)  =  C(t)x(t), 

(2) 

where  z(t)  =  |  q(t)  q(t)  | ,  y(t)  =  q(t),  u(t)  =  x(t) ,  and 
A(t),  B(t),  and  C(t)  are  time- varying  matrices. 

Now  if  the  inputs  to  the  above  system  are  sampled 
with  ZOH  devices,  as  shown  in  Figure  1, 


Figure  1  -  Linear  Time-Varying  Multivariable 
Discrete  System 

then  the  resulting  system  is  a  linear,  time- varying, 
discrete  system  described  by 


where  0(1,  to)  is  the  state  transition  matrix  of  the 
continuous  system  (2).  Methods  of  computing  the  state 
transition  matrix  are  well  known  and  can  be  found  in 
[6]. 

If  the  resulting  discretized  system  is  determined  to  be 
uniformly  controllable,  uniformly  observable,  and 
lexicografixed,  then  optimization  and  stabilization 
methods,  similar  to  those  in  [2]-[5],  should  be  possible. 

There  are  several  obstacles  preventing  the  application 
of  this  scheme.  The  concepts  of  controllability, 
observability,  and  lexicografixedness  have  not  been 
developed  for  time- varying,  discrete  systems.  In 
addition,  the  methods  in  [2]-[5]  apply  only  to 
continuous  systems.  Similar  methods  need  to  be 
developed  for  discrete  systems.  These  obstacles  are  the 
subject  of  on-going  research.  Results  in  the  area  of 
controllability  will  be  presented  in  the  following 
section. 

3  Controllability  of  Linear  Time- 
Varying  Multivariable  Discrete  Systems 

In  section  3.1,  a  controllability  matrix  for  linear,  time- 
varying,  multivariable,  discrete  systems  is  derived.  The 
utility  of  this  matrix  will  become  apparent  in  section 
3.2,  where  a  controllability  theorem  for  this  class  of 
systems  is  introduced  and  proved. 

3.1  Derivation  of  the  Controllability  Matrix 

Consider  a  linear,  time- varying,  multivariable, 
discrete,  control  system  whose  state  equation  is  defined 
as 

x((k  +  1)T)  =  F(k,  T)x(kT) + G(k,  T)u(kT) , 


x((k  +  1)T)  =  F(k,  T)x(kT)  +  G(k,  T)u(kT) 

y(kT)  =  C(kT)x(kT).  where 


(6) 


(3) 

The  state  and  input  matrices  of  the  discrete  system  are 
defined  by 


and 


F(k,  T)  =  3>((k  +  1)T,  kT) 


(k+l)T 

G(k,T)  =  J<D((k  +  l)T,x)B(T)dT, 

kT 


(4) 


(5) 


x(kT)  =  (nxl)  state  vector  at  the  kth  sampling  instant 
u(kT)  =  (rxl)  control  vector  at  the  kth  sampling  instant 
F(k,T)  =  (nxn)  state  matrix  at  the  kth  sampling  instant 
G(k,T)  =  (nxr)  input  matrix  at  the  kth  sampling  instant 
T  =  the  sampling  period. 

Definition:  The  discrete-time  control  system  given  by 
(6)  is  said  to  be  completely  state  controllable,  if  there 
exists  a  piecewise-constant  control  vector  u(kT)  defined 
over  a  finite  number  of  sampling  periods,  such  that 
starting  from  any  initial  state  the  state  x(kT)  can  be 
transferred  to  the  desired  state  xf  in  at  most  n  sampling 
periods  [6]. 
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Using  the  previous  definition,  a  controllability  matrix 
for  a  linear,  time- varying,  multivariable,  discrete  system 
will  now  be  derived.  By  recursion,  the  solution  to  the 
system,  x(kT),  can  be  found.  That  is: 

For  k=0, 

x(T)  =  F(0,  T)x(O) + G(0,  T)u(O) . 

(7) 

For  k=l, 


x(  nT)  -  [F(n  - 1,  T)F(n  -  2,  T). . .  F(0,  T)]x(0) 

=  Z^o[F<n-1*T)F(n-2,T)...F(j+l,T)]G(j,T)u(jT) 

=  [F(n-l,T)F(n-2,T)...F(l,  T)]G(0,  T)u(O) 

+{F(n  - 1,  T)F(  n  -  2,  T). . .  F(2,  T)]G(1,  T)u(T) 

+[F(n  -  l,T)F(n  -  2,T). . .  F(3,  T)]G(2,T)u(2T) 
+...+G(n-l,T)u((n-l)T). 


Equation  (13)  can  be  written  in  a  matrix  form  as 


x(2T)  =  F(l, T)F(0, T)x(O)  +  F(1,T)G(0, T)u(O)  x(nT)  [F(n  1,T)F(n  2>T)—F(0,T)]x(0)  - 


+G(l,T)u(T). 

G(n-1,T) 

T 

u((n-l)T) 

F(n-l,T)G(n-2,T) 

u((n-2)T) 

(8)  : 

: 

For  k=2, 

[F(n  - 1,  T)F(n  -  2,  T). . .  F(l,  T)]G(0,  T) 

u(0) 

x(3T)  =  F(2,  T)F(  1 ,  T)F(0,  T)x(0) 

+F(2,  T)F(  1 ,  T)G(0,  T)u(0) 

+F(2,  T)G(  1 ,  T)u(T)  +  G(2,T)u(2T). 

(9) 

For  k=3, 

x(4T)  =  F(3,  T)F(2,  T)F(1,  T)F(0,  T)x(O) 

+F(3,  T)F(2,  T)F(1,  T)G(0,  T)u(O) 

+F(3,  T)F(2,  T)G(1,  T)u(T) 

+F(3,T)G(2,  T)u(2T) + G(3,  T)u(3T). 

GO) 

Repeating  this  procedure,  gives 

x(kT)  =  [F(k  -  l,T)F(k  -  2,T). . .  F(0,T)]x(0) 
+Z^‘[[F(k-l.T)F(k-2,T)...F(j+l,T)]G(jT)u(jT). 

(11) 

If  k=n,  the  following  equation  is  obtained. 


x(nT)  =  [F(n-  l,T)F(n-2,T)...  F(0,T)]x(0) 

+Z^[fF(n-1-T)F(n-2.T)-F(j+1.T)]G(jT)u(jT) 

(12) 

The  previous  equation  can  be  rewritten  as 


(14) 

Consequently,  a  controllability  matrix  can  be  defined 
as 


G(n-1,T) 

F(n-l,T)G(n-2,T) 

[F(n-l,T)F(n-2,T)...F(l,T)]G(0,T) 


Substituting  (15)  into  (14)  yields, 


(15) 


x(nT)  -  [F(n  - 1,  T)F(n  -  2,  T). . .  F(0,  T)]x(0) 
u((n-l)T) 
u((n-2)T) 

u(0) 

(16) 

In  compact  form,  the  controllability  matrix  can  be 
written  as 

S(T)  =  |  So(T)  Si(T)  ...  Sn-i(T)|, 
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where 


X(nT)  =  S(T)U(nT) . 


So(T)  =  G(n-1,T), 

(18) 

and 


1 

Si(T)  =  nP(n-j.T)  G(n-l-i,T). 

-  i~i 

(19) 

Since  G(k,T)is  an  (nxr)  matrix,  each  of  the  matrices 
So(T),  Si(T),...,Sn.i(T)  is  an  (nxr)  matrix.  Therefore,  the 
controllability  matrix  is  an  (nxnr)  matrix. 

3.2  Controllability  Theorem 

Testing  for  the  state  controllability  of  a  linear,  time- 
varying,  multivariable,  discrete  system  is  greatly 
facilitated  by  the  following  theorem. 

Theorem:  The  state  equation  (6)  of  a  linear,  time- 
varying,  multivariable,  discrete,  system  is  completely 
state  controllable,  if  and  only  if  the  rank  of  the  (nxnr) 
controllability  matrix  is  n  at  some  sampling  period,  T. 
The  condition  for  complete  state  controllability  is 


(22) 

If  the  system  is  assumed  to  be  completely  state 
controllable,  then  every  initial  state,  X(0),  can  be 
transferred  by  unconstrained  controls,  U(nT),  to  any 
final  state,  X(nT),  for  finite  N.  Thus  the  problem  is  that 
of 

given  S(T)  and  every  vector  X(nT)  in  the  n-dimensional 
state  space,  solve  for  the  controls  U(nT).  Since  (22) 
represents  n  simultaneous  linear  equations,  from  the 
theory  of  linear  equations,  these  equations  must  be 
linearly  independent  for  solutions  to  exist.  Therefore 
the  matrix  S(T)  must  have  full  rank  (equal  to  n)  for 
solutions  to  exist. 

Contradiction  is  used  to  prove  the  sufficiency  of  the 
theorem.  Assume  that  the  controllability  matrix  does 
not  have  full  rank,  and  that  the  system  is  completely 
state  controllable.  If 

rank(S(T))  <  n, 

(23) 

then,  from  the  theory  of  linear  equations,  S(T)  does  not 
have  n  linearly  independent  columns.  If  S(T)  does  not 
have  at  least  n  linearly  independent  columns,  then  given 
X(nT)  and  U(nT),  the  set  of  simultaneous  linear 
equations,  given  in  (22)  as 


rank(S(T))  =  n. 

(20) 

Proof:  The  proof  is  similar  to  that  of  linear,  time- 
invariant,  discrete  systems  [6],  To  prove  the  necessity, 
assume  the  state  equation  is  state  controllable,  and  then 
show  that  the  rank  of  the  controllability  matrix  equals  n. 
The  state  transition  equation  of  the  discrete  system  was 
written  in  (16)  as 

x(nT)  -  [F(n  - 1,  T)F(n  -  2,  T). . .  F(0,  T)]x(0) 
u((n-l)T) 
u((n  -  2)T) 

u(0) 

(21) 

The  left  hand  side  of  the  previous  equation  can  be 
represented  as  an  (nxl)  vector,  X(nT).  Then  (21)  can 
be  written  as 


X(nT)  =  S(T)U(nT), 

(24) 

cannot  be  solved. 

This  means  that  unconstrained  controls  to  transfer 
every  initial  state  X(0)  to  any  final  state  X(nT)  cannot 
be  found.  This  contradicts  the  assumption  that  the 
system  is  completely  state  controllable.  Consequently, 
the  rank  condition  given  by  (20)  is  found  to  be  a 
necessary  and  sufficient  condition  for  complete  state 
controllability.  The  proof  is  now  complete. 

4  Example 

This  section  contains  an  example  to  illustrate  the 
concepts  presented  in  the  previous  two  sections.  In  this 
example,  it  is  assumed  that  the  fixed-point  linearization 
scheme  has  been  applied  to  a  non-linear  robotic  system 
and  that  the  linearization  point  is  allowed  to  vary.  The 
result  is  a  linear,  time-varying,  continuous  system  with 
dynamic  equations  given  by  (2).  Assume  that  the  state 
equation  of  the  resulting  system  is  given  by 


107 


-1  exp(2t)  t2 

x(t)=  o  -i  x(t)+  o  u(t)' 


The  controllability  matrix  can  be  computed  as 


Q(t)  = 


t2  +2t 


S(T)  = 


(+2T  -  T2  —  2)  exp(-T) 
+4T2  -  4T  +  2 


-2exp(-2T) 


+(t2  -  2T+  2)exp(-T) 


T3  —  exp(4T) 

+Texp  1 

--exp(2T) 

V  2  j 


It  is  obvious  that  the  determinant  of  the  controllability 
matrix  is  zero.  This  implies  that  the  system  is  not 
uniformly  controllable.  Therefore  the  methods  in  [2]- 
[5],  cannot  be  used  to  control  the  system. 

However,  the  scheme  introduced  in  section  2  can  be 
used  to  control  the  system.  The  system  is  discretized  by 
the  application  of  a  sample  and  zero-order  hold  to  the 
input.  If  this  is  done,  the  discretization  equations  (4)- 
(5)  must  be  applied  to  the  system.  The  state  equation  of 
the  resulting  linear,  time- varying,  discrete  system  is 
given  by  (6).  The  resulting  state  and  input  matrices  are 
computed  as 

(l  1  > 

F(k  X)  =  T)  expl  2  exP(2(k  +  1)T  2  cxp(2kT) 

1  exp(-T) 


r-2  lexp(-T) 


+T  -2T+2 


The  theorem  presented  in  section  3,  states  that  a 
discrete  system  is  completely  state  controllable,  if  and 
only  if  the  controllability  matrix  has  full  rank  for  some 
sampling  period.  It  is  also  well  known  that  the 
controllability  matrix  has  full  rank  at  values  of  T  for 
which  the  determinant  of  the  controllability  matrix  is 
non-  zero.  Solving  for  the  determinant,  yields 

f  \  2  ^ 

S  det(T)  =  -|jT5  T4  -4T3  -  2T2  +4T-4  Jexp(-2T) 

_  t5  -^T4  +  16T2  -  16T+8 jexp(-T) 

-^■T6  exP^~  exp(4T)  -  ^  exp(2T)  j 
+4T4  -  12T3  + 1 8T2  -  12T+4. 


(-k  2T2  +  2kT  -  2)  exp(-T)  ] 

G(k,T)  =  [+(k2+2k+l)T2-(2k+2)T+2j 

fck+D’-ik’V 

3  J 


From  (17)-(19),  the  controllability  matrix,  for  a 
single-input  system  in  which  the  state  matrix  has 
dimension  n=2,  is 

S(T)  =  |  G(1,T)  F(1,T)G(0,T)  |. 


Solving  for  the  controllability  matrix,  yields 


The  above  equation  is  plotted  as  a  function  of  the 
sampling  period. 


0.1  0.2  0.3  T  0 .4  0.5  0.6  0.7 


Figure  2  -  Determinant  as  a  Function  of  Sampling 
Period 


108 


Figure  (2),  shows  that  the  value  of  the  determinant 
starts  out  at  zero  and  then  decreases.  Upon  close 
inspection,  it  can  be  seen  that  the  determinant  is  non¬ 
zero  for  T>0.32.  Additionally,  solving  the  previous 
equation  shows  that  the  determinant  approaches  infinity 
for  T>0.89.  Since  a  determinant  of  infinity  is  also 
undesirable,  it  can  be  concluded  that  the  system  is 
completely  state  controllable  for  sampling  periods  in 
range  of 


0.32  <T<  0.89. 


(32) 

Now  a  sampling  period  will  be  selected  and  it  will  be 
shown  that,  given  an  initial  state,  the  system  can  be 
transformed  into  a  final  desired  state  in  n  sampling 
periods.  If  a  sampling  period  of  T=0.5  seconds  is 
selected,  the  state  equation  becomes 


xo(k  +  l) 
xi(k  +  l) 


1  i' 


exd 


exPl 


— exp(k+l) 


— rk2  +  k 


--exp(k) 
v  2 

4i) 

-2M4l 


xo(k) 

xi(k) 


1 


2  1  .  5 


vV 2kn 
1,2  1,  1 
ik 


u(k). 


If  the  initial  state,  at  k=0,  is  given  as 


(33) 


xo(2) 

xi(2) 


| 

-f  exp[-i]+  l)i(l) 


+exd 


1  1 
— exp(2)  -  — exp(l) 


(2+5“>(-l 


-2  exp( 


-,)+!“,(4) 


exp(2)  -  -exp(l) 


J) 


ko) 


1 Y  f  H  (  i  i  \ 

+exp^-l2ex^--J+  5exp|^-exp(l)  -  -I 
7  f  47  f  H  5]  (  1 

24“(1)  +  li-24e,V2  J+ 4  j,(°)  +  2eTI 


+5exd 


2exP(!) 


0  (  1 


2  +  5exp^-- 


(36) 


If  the  desired  state  is  given  as 


1 

xo(2) 

2 

xi(2) 

5 

2 

(37) 

then  it  can  be  shown,  by  substituting  (37)  into  (36)  and 
then  solving  the  set  of  simultaneous  linear  equations, 
that  inputs  of 


xo(0) 

2 

xi(0) 

5 

(34) 


then  the  state  equation,  at  k=0,  becomes 


xo(l) 

xi(l) 


(  l) 

2expi~2  r5exp 

fi  01 

jetcpd)--] 

f 5  (  1 V 

+  --2exp-- 

ko) 

V4  V  2 

(  r 

*  J 

\  i 

2+5exp 

V  2, 

/  24  u(0) 

(35) 


The  state  equation,  at  k=l,  becomes 


u(0)  =  -119.956  and  u(l)  = -20.944 


(38) 

will  produce  the  desired  state  (37). 

5  Conclusions 

This  paper  presents  the  development  of  a  new  robotic 
control  scheme.  The  scheme  involves  linearizing, 
through  fixed-point  linearization,  and  discretizing, 
through  sample  and  hold  techniques,  the  robotic  system. 
Through  the  application  of  these  methods,  a  robotic 
system  can  be  modeled  as  a  linear,  time-varying, 
multivariable,  discrete  system. 

Until  now,  the  concept  of  controllability  had  not  been 
developed  for  such  systems.  In  this  paper,  the 
controllability  of  linear,  time- varying,  multivariable. 
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discrete  systems  was  investigated.  Using  the  definition 
of  controllability,  a  controllability  matrix  was  derived 
and  a  controllability  theorem  introduced.  It  was  proved 
that  the  full  rank  condition  of  the  controllability  matrix 
is  a  necessary  and  sufficient  condition  for  the  system  to 
be  completely  state  controllable.  Through  an  example, 
it  was  shown  that,  if  the  system  is  controllable,  the  state 
variables  of  a  linear,  time- varying,  discrete  system  can 
be  transformed  to  any  arbitrary  state  in  a  finite  number 
of  sampling  periods. 

On-going  research  focuses  on  expanding  these  results 
to  the  observability  property  of  such  systems  and  then 
exploiting  the  uses  of  the  controllability  and 
observability  matrices.  State  feedback  controllers  and 
state  estimators  are  two  potential  applications.  Once 
these  concepts  have  been  fully  developed  for  linear, 
time-varying,  multivariable,  discrete  systems,  then  the 
implementation  of  the  control  scheme  presented  in  this 
paper  can  be  applied  to  control  non-linear  robotic 
systems. 
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